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Technical Field 

The present invention relates to a recording medium 
such as a BD-ROM, and to a reproduction apparatus . The present 
invention particularly relates to an interactive control 
technology for combining, with a. motion picture made of a 
plurality of pictures, an interactive display made of a 
plurality of buttons , and for realizing reproduction control 
in accordance with a user operation directed to the buttons . 



Background Art 

The interactive control described above is an 
indispensable function for reproduction apparatuses in 
receiving a user operation on selection of title and chapter 
to be reproduced, a reply to a quiz question, and the like, 
and is widely known to be realized on DVD reproduction 
apparatuses . The interactive control by a DVD reproduction 
apparatus is an application of OSD (on screen display) 
technology by which a button being a character string attached 
to a graphics is displayed on a screen, and the color of a 
frame of the button is changed according to a user operation. 
Such color change enables a user to intuitionally understand 
which button on the interactive display is in a selected state . 

A disadvantage of the interactive control on a DVD is 
that there is hardly any factor for amusement . Specifically, 



users hardly find it amusing during operation of the DVD 
interactive control. In view of such criticism, animation 
display of buttons is attempted on the interactive display 
of a BD-ROM (Blu-ray disk prerecorded format) whose 
5 standardization is underway. To be more specific, in the 
interactive display presented by a BD-ROM, each button is 
presented in a form of original animation, and is overlayed 
with a scene of a movie, which is the main video image. In 
addition, the content of this animation display changes 

10 according to a user operation . When such an animation display 
is used to represent a character appearing on a movie work, 
a user can change the expression and action of the character 
by his operation directed to the interactive display. Such 
a kind of animation enables creation of interactive display 

15 by which even a child is amused. 

However, the animation display for buttons incurs a 
large amount of decoding load, and so there is a problem that 
a waiting time, until an initial display of the interactive 
display is realized, becomes long. For example, assume that 

20 an interactive display such as shown in FIG . 1 is overlayed 
with a scene of a movie work. This interactive display has 
four buttons, each of which has three states: normal state; 
selected state; and active state . Also assume a case in which 
each state of button is presentedin 2-3 seconds of animation 

25 display. Even if one page of graphics data is displayed at 
intervals of 5 frames in an image signal, about 30 pages of 
graphics data are required to realize 2-3 seconds of animation 
Not only that, since there are three states for a button (normal 



state, selected state, and active state) , there will be total 
of 90 pages (3*30) of graphics data. So as to dispose four 
buttons on an interactive display, it requires decoding of 
360 pages (4*90), which is an enormous amount of graphics 
5 data. Decoding load for one page of graphics data is light. 
However, it takes about dozens of seconds so as to decode 
several hundreds of pages of graphics data . Even for a purpose 
of making amusing interactive displays, it is too much to 
keep users waiting dozens of seconds to display each 
10 interactive display, which deserves users 7 criticism. 

Disclosure of the invention 

The object of the present invention is to provide a 
recording medium that realizes interactive display with 

15 animation, without delay. 

So as to achieve the above -described object , the present 
invention provides a recording medium having: a graphics 
stream; where: said graphics stream represents an interactive 
display to be overlayed with a motion picture made of a 

20 plurality of pictures, the interactive display including at 
least one graphical button material; said graphics stream 
includes a plurality of pieces of graphics data that are 
grouped under state sets; and the state sets respectively 
correspond to different states of the at least one button 

25 material and are disposed in a sequential order. 

Under the above construction, suppose there are 36 0 
pages of graphics data for rendering animation, and there 
are three states for eachbutton material . Then , the graphics 



data will be grouped under three state sets (e.g. 120 + 120 + 120 
pages) . Then each of the state sets is placed so that the 
set that appears earlier in the animation will be placed nearer 
to the top, and the set that appears later will be placed 
5 farther to the top. Accordingly, in reproduction, the 
earlier appearing button- state set will be loaded to the 
reproduction apparatus early, postponing loading of later 
appearing button-state sets. By doing so, when once 
reading/decoding of about 1/3 - 2/3 of the entire graphics data 

10 are complete , the preparation for an initial display is ready, 
even though not all of the 3 60 pages of graphics, data have 
not been finished being decoded. 

This further means that in a case where there is an 
enormous amount of graphics data to be read/decoded , execution 

15 of initial display will not be delayed. According to this, 
the interactive display with animation can be performed 
without delay . 

Brief Description of the Drawings 

20 FIG.l illustrates an interactive display composed of 

animation . 

FIG.2A illustrates an example of use of a recording 
medium according to the present invention. 

FIG.2B illustrates a key disposition on a remote 

25 controller 400, through which a user operation directed to 

the interactive display is received. 

FIG. 3 is a diagram showing . a structure of a BD-ROM. 
FIG. 4 is a diagram schematically illustrating a 
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structure of an AV Clip. 

FIG. 5 is a diagram illustrating an internal structure 
of Clip information . 

FIG. 6 is a diagram illustrating an internal structure 
of playlist information (PL information) . 

FIG . 7 is a diagram schematically showing an indirect 
reference by means of PL information. 

FIG . 8A is a diagram illustrating a structure of the 
interactive graphics stream. 

FIG. 8B is a diagram illustrating an internal structure 
of each of an ICS and an ODS . 

FIG. 9 is a diagram illustrating a logical structure 
constituted by a various kind of functional segments . 

FIG.10A is a diagram illustrating a data structure of 
an ODS , which defines a graphics object. 

FIG.10B is a diagram illustrating a data structure of 

a PDS. 

FIG. 11 is a diagram illustrating a data structure of 
an Interactive Composition Segment. 

FIG. 12 is a diagram illustrating a relation between 
ODSs in a DSn and an ICS. 

FIG. 13 is a diagram illustrating a screen composition 
at a display timing of arbitrary picture data ptl . 

FIG . 14 is a diagram illustrating a setting example of 
button information in ICS. 

FIG. 15 is a diagram illustrating one example of the 
state transition of buttons A-D. 

FIG. 16 is a diagram illustrating one example of the 



design images of the 0DS11, 21, 31, and 41. 

FIG. 17 is a diagram illustrating one example of the 
design images of the ODS11-19 of the button A. 

FIG. 18 is a diagram illustrating one example of ICS 
5 and ODS included in a DS . 

FIG. 19 is a diagram illustrating the order of ODSs 
belonging to a Display Set, as well as button-state sets. 

FIG. 20 is a diagram illustrating a state transition 
of an interactive display at which the button-state sets of 
10 FIG. 19 are disposed. 

FIG. 21 is a diagram illustrating the order of ODSs in 
a Display Set. 

FIG . 22 is a diagram illustrating difference in the order 
of ODSs in a S-ODSs, between a case when 
15 default__selected_button_number is tt 0 ;/ , and when it is "button 
B" . 

FIG.23A and FIG.23B are diagrams for showing the 
concrete value for £SIZE (DSn [ ICS . BUTTON [ i ] ] ) , in a case when 
N-ODSs include a plurality of ODSs constituting the buttons 
20 A-D, and S-ODSs include a plurality of ODSs constituting the 
buttons A-D. 

FIG. 24 is a diagram showing a timing of synchronized 
display by means of ICS. 

FIG. 2 5 is a diagram showing how to set DTS and PTS , 
25 in a case when a plurality of ODSs compose an initial display 
of an interactive display and the 

def ault_selected_button_number is valid . 

FIG. 26 is a diagram showing how to set DTS and PTS, 



in a case when a plurality of ODSs compose an initial display 
of an interactive display, and the default selected button 
is invalid. 

FIG. 27 is a diagram showing the internal structure of 
a reproduction apparatus according to the present invention . 

FIG. 28 is a diagram showing a storage content of the 
object buffer 15, in contrast to the graphics plane 8. 

FIG. 29 is a diagram showing the processing performed 
by the graphics controller 17- at an initial display. 

FIG . 30 is a diagram showing processing of the graphics 
controller 17 at an update of an interactive display according 
to IstUserAct ion ( MoveRight ) . 

FIG. 31 is a diagram showing processing of the graphics 
controller 17 at an update of an interactive display according 
to IstUserAction (MoveDown) . 

FIG. 32 is a diagram showing processing of the graphics 
controller 17 at an update of an interactive display according 
to IstUserAction (Activated) . 

FIG. 33 is a timing chart showing pipelining performed 
by the reproduction apparatus . 

FIG. 34 is a timing chart showing pipelining performed 
by the reproduction apparatus in a case where the default 
selected button dynamically changes . 

FIG. 35 is a flowchart showing the execution procedure 
for LinkPL function, performed by the control unit 20. 

FIG. 36 is a flowchart showing the procedure of loading 
processing for Segment. 

FIG . 37 is a diagram showing one example of multiplexing . 



FIG. 38 is a diagram showing the manner in which DS10 
is loaded to the coded data buffer 13 of the reproduction 
apparatus . 

FIG. 3 9 is a diagram showing a case in which a normal 
5 reproduction is performed. 

FIG. 4 0 is a diagram showing how the loading of DS1, 
DS10, and DS20 is performed when a normal reproduction is 
performed as in FIG. 39. 

FIG . 41 is a flowchart in which processing corresponding 
10 to the main routine in the processing of the graphics 
controller 17 is described. 

FIG . 42 is a flowchart showing the processing procedure 
for synchronized control performed by means of a time stamp. 

FIG . 43 is a flowchart showing the procedure for writing 
15 processing directed to the graphics plane 8. 

FIG. 44 is a flowchart showing a processing procedure 
for auto - activating a default selected button. 

FIG. 4 5 is a flowchart showing a processing procedure 
for an animation display. 
20 FIG. 46 is a flowchart showing a processing procedure 

of a UO processing. 

FIG. 47 is a flowchart showing a procedure of changing 
processing for a current button. 

FIG. 48 is a flowchart showing a procedure of numerical 
25 inputting processing. 

FIG . 49 is a diagram showing a pipeline in a reproduction 
apparatus, based on DTS, and PTS in PDS . 

FIG. 50 is a diagram showing a meaning of an END during 



pipelining of the reproduction apparatus. 

FIG. 51 is a flowchart showing a production method of 
a BD-ROM that relates to the second embodiment. 

FIG. 5 2 is a diagram showing an internal structure of 
5 PL information relating to the third embodiment. 

FIG. 53 is a diagram schematically showing 
synchronization of sub Playltem according to 
n sync_PlayItem__id, sync_start_PTS_o f_PlayItem" . 

FIG. 54 is a diagram showing file identification byway 
10 of xx Clip_Inf ormation__f ile_name" within the playlist 
information on an HD . 

Best Mode for Carrying Out the Invention 
( First Embodiment ) 

15 The following describes an embodiment of a recording 

medium, relating to the present invention. Firstly, among 
the embodiments of a recording medium according to the present 
invention, an example of how the recording medium is used 
is explained as follows. FIG . 2A is a diagram illustrating 

20 a use of the recording medium according to the present 
invention. In FIG.2A, the recording medium of the present 
invention is a BD-ROM 100. This BD-ROM 100 is used to supply 
a movie work to a Home . Theatre System structured by a 
reproduction apparatus 200, a television 300, and a remote 

25 controller 400. Among them, the remote controller 400 is 
used to receive an operation to change the state of the 
interactive display, from a user, and is closely related to 
the recording medium of the present invention. FIG.2B 



illustrates keys of the remote controller 4 00, through which 
a user operation directed to the interactive display is 
received. As shown in this drawing, the remote controller 
4 00 is provided with a MoveUp key, a MoveDown key, a MoveRight 
5 key, and a MoveLef t key . Here, the buttons on the interactive 
display have three states : normal state; selected state; and 
active state. The MoveUp key , the MoveDown key , the MoveRight 
key, and the MoveLef t key are used to receive a user operation 
to change the state of the buttons into normal state— selected 

10 state— active state. The normal state is a state in which 
mere display is provided, whereas the selected state is a 
state in which a focus is given according to a user operation, 
but confirmation has not been received. The active state 
is a state in which confirmation is received. The MoveUp 

15 key is for, when a button in the interactive display is in 
a selected state, setting a button above this selected button , 
to be in a selected state. The MoveDown key is for setting 
a button below this selected button to be in a selected state. 
The MoveRight key is for setting a key on the right of the 

20 selected key to be in a selected state, and the MoveLef t key 
is for setting a key on the left of the selected key to be 
in a selected state. 

The Activated key is for setting the selected button 
to be in an active state (i.e. to activate) . Numerical keys 

25 wQrr.wQff are f or se tting a button to which a corresponding 
number is assigned, to be in a selected state. NX + 10" key 
is for receiving an operation to add 10 to the already inputted 
numerical values. It should be noted here that "0" key and 



xx + 10" key are both for receiving input of numerical value 
of no smaller than 10 digits. Therefore any one of them is 
enough for the remote controller 400. 

Sofar, the description is about how the recording medium 
of the present invention is used. 

As follows, among the embodiments of the recording 
medium of the present invention, a production example is 
explained. The recording medium of the present invention 
is produced by improving the application layer of a BD-ROM. 
FIG. 3 is a diagram showing a structure of a BD-ROM. 

In the drawing, the BD-ROM is shown at a fourth row 
of the drawing, and a track on the BD-ROM is shown in the 
third row. The track is actually in a spiral shape on the 
disk , but shown as a line extending in the lengthwise direction 
of the drawing. The track includes a lead-in area, a volume 
area, and a lead-out area. The volume area in this drawing 
has a physical layer, a file system layer, and an application 
layer . In the first row of the drawing, an application format 
of the BD-ROM is illustrated using a directory structure. 
As illustrated in the drawing, the BD-ROM has a directory 
BDMV under the root directory , and the BDMV directory contains 
such files as XXX.M2TS, XXX.CLPI, and YYY . MPLS . By forming 
the above application format, it is possible to produce the 
recording medium according to the present invention . In a 
case in which there is more than one file for each kind, it 
is preferable to provide three directories named STREAM, 
CLIPINF, and PLAYLIST under the BDMV to store the files with 
the same extension in one directory. Specifically, it is 
desirable to store the files with the extension M2TS in the 
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STREAM, the files with the extension CLPI in the CLIPINF, 
and the files with the extension MPLS in the PLAYLIST. 

As follows, each file in the application format is 
explained. Firstly, an explanation about the AV Clip 
(XXX.M2TS) is given. 

The AV Clip (XXX.M2TS) is a digital stream in MPEG-TS 
format (TS is Transport Stream) obtained by multiplexing a 
video stream, at least one audio stream, a presentation 
graphics stream, and an interactive graphics stream. The 
video stream represents motion pictures of the movie, the 
audio stream represents sound of the movie, the presentation 
graphics stream represents subtitles of the movie, and the 
interactive graphics stream represents dynamic reproduction 
control procedure directed to menus. FIG. 4 is a diagram 
schematically illustrating a structure of the AV Clip. 

The AV Clip (middle row) is structured in a following 
manner. A video stream made of plural vide frames (pictures 
Pjl' Pj2, and pj3) , and an audio stream made of plural audio 
frames (top row of the drawing) are respectively converted 
into a PES packet sequence (second to top row of the drawing) , 
and then into a TS packet sequence (third to top row of the 
drawing) . Then a presentation graphics stream and an 
interactive graphics stream (bottom row of the drawing) are 
converted into a PES packet sequence (second to bottom row 
of the drawing), and then into a TS packet sequence (third 
to bottom row of the drawing) . The TS packet sequences are 
multiplexed, to obtain the AV Clip. 

The AV Clip constituted in the above manner is divided 
into more than one extent, like ordinary computer files, and 
stored in areas in the BD-ROM. The AV Clip is made of one 

12 



or more ACCESS UNITs . Each ACCESS UNIT functions as a unit 
of random access, as well as a decoding unit starting with 
an Intra (I) picture. 

Clip information (XXX.CLPI) is management information 
for an AV Clip. FIG . 5 is a diagram illustrating an internal 
structure of the Clip information. Since an AV Clip is 
obtained by multiplexing a video stream and an audio stream, 
and has ACCESS UNITS that each functions as a unit of random 
access, specific items managed by the Clip information are: 
attributes of each of the video stream and the audio stream; 
and at which position in the AV Clip a random access point 
exists . 

In the drawing, the broken leader lines help clarify 
a structure of the Clip information. As the leader line hnl 
shows, the Clip information (XXX.CLPI) is comprised of: 
"attribute information" about the video stream and the audio 
stream; and "EP_map" being a reference table used in making 
a random access to the ACCESS UNITs. 

As the leader line hn2 shows, the attribute information 
( "Attribute" ) is comprised of : "Video attribute information" 
that is attribute information on a video stream; "Number" 
indicating the number of sets of attribute information; and 
"Audio attribute information #l-#m" that each representing 
attribute information for a corresponding one of a plurality 
of audio streams to be multiplexed onto the AV Clip. As the 
leader line hn3 shows, the Video attribute information 
indicates what kind of compression method was employed to 
compress the video stream (Coding) , and a resolution 
(Resolution), an aspect ratio (Aspect), and a frame rate 



(Framerate) for each set of picture data constituting the 
video stream. 

As the leader line hn4 shows, audio attribute 
information #1- #m ( attribute information on the audio stream) 
indicates what kind of compression method was employed to 
compress the audio stream (Coding), a channel of the audio 
stream (Ch. ) , which language the audio stream corresponds 
to (Lang) , and a sampling frequency of the audio stream. 

EP_map is a reference table used for performing indirect 

reference to the addresses of a plurality of random access 

points , using time information . As the leader line hn5 shows , 

the EP_map is comprised of : a plurality of sets of entry 

information (ACCESS UNITS 1 entry , ACCESS UNIT #2 entry , ACCESS 

UNIT#3 entry...), and entry number (Number). As the leader 

line hn6 shows, each entry indicates a reproduction start 

time of a corresponding ACCESS UNIT and the address of the 

ACCESS UNIT, in association (Note that it is possible to enter 

the size of the first I picture in the ACCESS UNIT (I-size) ) . 

A reproduction start time of an ACCESS UNIT is expressed by 

a time stamp of picture data positioned at the beginning of 

the ACCESS UNIT (presentation time stamp) . In addition, an 

address of an ACCESS UNIT is expressed by a serial number 

of a corresponding TS packet (SPN( Source Packet Number)). 

In coding, the variable length coding compression method is 

adopted. Therefore, even if there are varieties in size and 

* 

reproduction time between each ACCESS UNIT including GOP, 
it becomes possible to perform random access, from any 
reproduction time, to the picture data of the ACCESS UNIT 
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corresponding to a destination reproduction time, by- 
referring to the entry of this ACCESS UNIT. 

Note that the file name XXX in XXX.CLPI is. identical 
to the name of an AV Clip whose Clip information matches. 
For example, the file name of the AV Clip in this drawing 
is XXX, and so it corresponds to the AV Clip (XXX.M2TS) . Next, 
playlist information (PL information) is explained. 

YYY.MPLS (playlist information) is a table 
constituting a playlist being reproduction path information , 
and is comprised of a plurality of pieces of Playltem 
information ( Playltem information^ , #2 , E3...#n ) , and Playltem 
information number (Number). FIG. 6 is a diagram 

illustrating an internal structure of playlist information. 
One piece of Playltem information defines one or more logical 
reproduction sections that constitute a playlist. The 
leader line hsl in the drawing helps clarify a structure of 
one piece of Playltem information . As this leader line shows , 
the piece of Playltem information is comprised of : 
VN Clip_Information_file_name ff representing a file name of 
reproduction section information of an AV Clip to which the 
In-point and Out-point of the reproduction section belongs; 
*Clip__codec__identif ier" representing a coding method used 
to encode the AV Clip; vv IN_time" being time information 
indicating a start point of the reproduction section; and 
xx OUT_point" being time information indicating an ending point 
of the reproduction section. 

The Playltem information is characterized by its 
notation method . Specifically , in the Playltem information , 
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reproduction sections are defined in an indirect way by means 
of time, using the EP_map as a reference table. FIG. 7 is 
a diagram schematically illustrating this indirect reference 
In this drawing, an AV Clip is comprised of a plurality of 
ACCESS UNITs. The EP_map of the Clip information specifies 
the addresses of the ACCESS UNITs as shown by the arrows ayl, 
2, 3, and 4. The arrows jyl, 2, 3, and 4 schematically show 
how the pieces of Playltem information are used to make a 
reference to the ACCESS UNITs. In other words, reference 
made by means of the pieces of Playltem information (i.e. 
the arrows jy 1, 2, 3, and 4) is able to specify the addresses 
of ACCESS UNITs within the AV Clip, via' the EP_map, and so 
can be regarded as an indirect reference using time concept 
by means of EP_map . 

A reproduction section on a BD-ROM, comprised of a 
combination of Playltem information, Clip information, and 
AV Clip is called "Playltem" . A logical reproduction unit 
on a BD-ROM, comprised of a combination of PL information, 
Clip information, and AV Clip is called 
"playlist" ( abbreviated as PL) . A movie work recorded in a 
BD-ROM is structured by such logical reproduction units (i.e. 
PL) . Therefore, it is easy to produce another movie work 
made of all the scenes with a character, by defining PLs 
specifying scenes with the character. 

Because movie works recorded in BD-ROMs have the 
aforementioned logical structure, quoting of an AV Clip 
constituting a scene of a movie work in another movie work 
can be efficiently performed. 



Next, the interactive graphics stream is described. 
FIG . 8A is a diagram illustrating a structure of the 
interactive graphics stream. The first row represents a TS 
packet sequence constituting the AV Clip. The second row 
5 represents a PES packet sequence constituting the graphics 
stream. The PES packet sequence in the second row is 
structured by extracting payloads from TS packets of the first 
row that include a predetermined PID, and then linking the 
extracted payloads together. Note that the presentation- 
10 graphics stream is not a main focus of the present invention, 
and so is not explained here. 

The third row represents the structure of the graphics 
stream. The graphics stream is made of functional segments 
of: ICS ( Interactive Composition Segment); PDS (Palette 
15 Definition Segment) ; ODS (Object_Def inition_Segment ) , and 
END (END of Display Set Segment) . Among these functional 
segments, ICS is called a display composition segment, and 
PDS, ODS, and END are respectively called a definition segment . 
The PES packet and each of the functional segments correspond 
20 one to one, or one to plurality. In other words, one 
functional segment is either recorded in the BD-ROM after 
converted into one PES packet , or after divided into fragments 
and converted into more than one PES packet . 

FIG.8B is a diagram illustrating PES packets obtained 
2 5 by converting the functional segments. As FIG . 8B shows, a 
PES packet is made of a packet header and a payload, where 
the payload is the substance of a functional segment. In 
addition, the packet header includes a DTS and a PTS 
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corresponding to this functional segment. Hereinafter, DTS 
and PTS included in a packet header are referred to as DTS 
and PTS of a functional segment. 

These various kinds of functional segments constitute 
a logical structure as shown in FIG . 9 . In this drawing, the 
third row represents functional segments, the second row 
represents Display Sets , and the first row represents Epochs . 

The second row is a collection of Display Sets 
(abbreviated as *DS" ) , each of which corresponds to graphics 
that make up one screen of graphics. The broken line in the 
drawing indicates to which DS the functional segments of the 
third row belong. As can be understand from the above, a 
series of functional segments of n ICS-PDS-ODS-END" 
constitutes one DS . A reproduction apparatus can constitute 
one screen of graphics by reading a series of functional 
segments constituting one DS , from the BD-ROM. 

Each Epoch in the first row represents a period having 
memory management continuity on a reproduction time axis for 
an AV Clip, and also corresponds to a data set assigned to 
this period. Here the assumed memory is a graphics plane 
that is for storing one screen of graphics , or an object buffer 
for storing graphics data in decompressed state. By stating 
a graphics plane or. an object buffer has memory management 
continuity, it is meant that a flash does not occur in the 
graphics plane or in the object buffer in a period represented 
by the Epoch, and deletion/re-drawing for graphics is 
performed only within a predetermined rectangular area within 
the graphics plane (Here, the flash means clearing all the 
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contents stored in the plane or in the buffer) . The size 
(length/width) and position of this rectangular area are fixed 
throughout an Epoch. As long as deletion/re-drawing of 
graphics is performed within this fixed area of the graphics 
5 plane, seamless reproduction is guaranteed. That is, an 
Epoch can also be considered as one unit on a reproduction 
time axis, at which seamless reproduction is guaranteed. If 
a user wants to change the area, he has to, define a change 
time on the reproduction time axis, and create a new Epoch 

10 that corresponds to the time after this change time. In this 
case, seamless reproduction will not be guaranteed between 
these two Epochs . 

Note that what is meant by xv seamless reproduction" is 
that deletion/re-drawing of graphics will complete within 

15 a predetermined video frame number. For an interactive 
graphics stream, this video frame number is 4 to 5 frames. 
This number of video frames is determined by a ratio of a 
fixed area to an entire graphics plane, and a transfer rate 
between the object buffer and the graphics plane. 

20 In the drawing, the broken lines hkl, 2 represent to 

which Epoch the functional segments in the third row belong. 
As can be understood from this drawing , a series of DS ( namely , 
Epoch Start, Acquisition Point, and Normal Case) constitutes 
an Epochof the first row. "Epoch Start" , "Acquisition Point" , 

25 and "Normal Case" are respectively a type of DS . Note that 
the order of " Acquisition Point" and "Normal Case" is merely 
one example, and can be reversed. 

"Epoch Start" is a DS that produces a display effect 
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of "new display", and indicates a start of a new Epoch. 
Therefore an Epoch Start has to include all the functional 
segments required to compose a next screen, and is disposed 
at a position in an AV Clip, which is destined for a random 
access target (e.g. chapter of a movie work). 

''Acquisition Point" is a Display Set that produces 
a display effect of "display refresh", and relates to a 
preceding "Epoch Start" . The Acquisition Point is 
classified into two types: Duplicate and Inherit. A 
Duplicate is a Display Set totally identical to a preceding 
Epoch Start, whereas an Inherit is a Display Set inheriting 
the functional segments from a preceding Epoch Start but has 
different button commands from the preceding Epoch Start. 
Although not representing a start time of an Epoch, an 
Acquisition-Point DS includes all the functional segments 
required to compose a next screen. Therefore if a random 
access is performed to an Acquisition-Point DS, graphics 
display is guaranteed . In other words , an Acquisition -Point 
DS enables a screen composition during an Epoch in progress. 

An Acquisition-Point Display Set is incorporated into 
a position that is a random access target. Such a position 
can be specified by time search. Time search is an operation 
in which input of time (minute and second) is received from 
a user, and random access is made to a reproduction time 
corresponding to the inputted time. Such time input is 
performed in a rough unit such as 10 minutes or 10 seconds, 
and so time search can specify reproduction points in 10 
minutes interval or 10 seconds interval. By providing 
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Acquisition Points at positions that can be specified by the 
time search, graphics stream reproduction will be facilitated 
at the time search. 

''Normal Case'' is a DS that produces a display effect 
5 of "'display update" , and only includes a difference with the 
prior display composition. For example, suppose that a 
button for a DSv has a same image design as a preceding DSu, 
but is under different state control from the DSu. In this 
case, the DSv is arranged either to only include ICS, or to 

10 only include ICS and PDS , and set the DSv as a Normal -Case 
DS . By doing so, it is not necessary to provide overlapping 
ODSs, and so helps reduce the occupied areas in a BD-ROM. 
Note that a Normal -Case DS cannot compose a screen by itself, 
because it represents only the difference. 

15 An interactive display defined by these DS is created 

by disposing GUI parts on a screen. By stating that a DS 
has interactivity, it means that the state of the GUI parts 
is changeable in accordance with a user operation. In the 
present embodiment , such GUI parts , which are a user operation 

20 target, are called "button" . The states of a button include 
"normal state", "selected state", and "active state", each 
of which is composed by a plurality of graphics in decompressed 
state. Each decompressed graphics representing a state of 
a button is called "graphics object". The reason why one 

25 state of each button is represented by a plurality of 
decompressed graphics is for the purpose of animation display . 

Next, the Definition Segments (ODS, PDS) are explained . 
"Ob j ect_Def inition_Segment" is information defining 
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a graphics object. The following explains this graphics 
object. An AV Clip, recorded' in a BD-ROM, features 
high-quality images that can be compared to those of a 
high-definition television . Accordingly, the resolution of 
the graphics object is high, which is 1920*1080 pixels, so 
as to produce a high definition . As for the color of a pixel, 
an index value for one pixel is set as 8 bit length. Here, 
the index value includes red color-difference component 
(Cr_value), blue color-difference component (Cb__value), 
brightness component (Y_value) , and transparency level 
(T_value) . By this setting, arbitrary 256 colors can be 
selected from 16,777,216 colors (full color), thereby 
enabling setting of the 256 colors as colors for the pixel. 

An ODS has a data structure as shown in FIG.10A, for 
defining a graphics object. An ODS is comprised of: 
"segment_type" that indicates that it is an ODS; 
"segment__length" that indicates a data length of the ODS; 
vx ob j ect_id" that uniquely identifies the graphics ob j ect that 
corresponds to this ODS in the Epoch; xx ob j ect_version_number" 
that indicates a version of the ODS in the Epoch; xx last in 
sequence flag"; and a continuous byte- length data 
xx object_data_f ragment" that is either a part or all of the 
graphics ob j ect . 

xx ob j ect__id" uniquely identifies the graphics object 
that corresponds to this ODS in the Epoch. However, when 
animation is constituted by a plurality of graphics objects 
defined by a plurality of ODSs, "ob j ect_id" assigned to each 
of the plurality of ODSs will be serial numbers . 



Next, xx last in sequence flag" and 

xx object_data_f ragment" are explained. There is a case where 
decompressed graphics constituting a button cannot be stored 
in one ODS , because of a constraint on the payload of a PES 
packet. In such a case, a division (fragment) of a button 
command is set as xx obj ect__data_f ragment " . When storing one 
graphics object in a plurality of ODSs, all the fragments 
have to have the same size, except the last fragment. That 
is, the last fragment will have smaller size than the other 
fragments . The plurality of ODSs storing these fragments 
will appear in the identical order in a DS . The last part 
of the graphics object is specified by an ODS having xx last 
in sequence flag" . The above-described data structure of 
an ODS assumes adoption of a storing method by which storing 
for a new PES packet does not start until a current PES packet 
becomes full . However, it is also possible to adopt a storing 
method by which there will be empty space in each PES packet. 

xx palette__def inition_segment (PDS)" is information 
that defines a palette for color conversion . A data structure 
of a PDS is shown in FIG.10B. As shown by FIG.10B, a PDS 
is comprised of: xv segment_type" that indicates that it is 
a PDS; xx segment_length" that indicates a data length of the 
PDS; xx palette_id" that uniquely identifies the palette 
included in the PDS ; xx palette_version_number " that indicates 
a version of the PDS in the Epoch; and xx palette__entry " that 
is information about each entry . xx palette_entry " represents 
a red color-difference component (Cr_value) , blue 
color-difference component (Cb_value) , brightness component 



(Y_value), and transparency level (T_value), for each entry . 

Next, END of Display Set Segment is explained. 

END of Display Set Segment is an index indicating an 
end of a Display Set transfer, and is disposed immediately 
after the last ODS . The internal structure of this "END of 
Display Set Segment" is comprised of: segment_type that 
indicates that this functional segment is an END of Display 
Set Segment; and segment_length that indicates a data length 
of the functional segment, which do not require particular 
explanation . Therefore the drawing does not show the 
internal structure . 

Next, an Interactive Composition Segment (ICS) is 
explained. An ICS is a functional segment constituting an 
interactive display. An ICS has a data structure shown in 
FIG. 11. As shown in this drawing, an ICS is comprised of: 
segment_type ; segment_length ; compos it ion_n umber ; 

compos it ion_state ; command_update_f lag ; 

compos it ion_timeout_PTS ; select ion_timeout_PTS ; UO_mask_ta 
ble ; an imat ion_f r ame_r a t e_code ; 

def ault_selected_button_n umber ; 

def ault_activated_button_n umber ; and "button information 
set (button info (1)(2)(3)). 

"composition_number" indicates whether update is 
performed in the DS to which the ICS belongs, and takes a 
number from 0 to 15 . 

"composition_state" indicates whether the DS that 
starts with the particular ICS is a normal case, acquisition 
case, or epoch start. 
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vx command_update_f lag" indicates whether the button 
commands in the ICS have any change from the counterparts 
of the preceding ICS. For example, when a DS that a certain 
ICS belongs to is an Acquisition Point, the ICS will have 
the same content as the immediately preceding ICS, in 
principle. However, when this command_update_f lag is set 
to be ON, it becomes possible to set, in the ICS, a button 
command different from the preceding DS . By this flag, a 
preceding graphics object can be appropriated, however the 
command gets valid when it is instructed to be changed. 

VN compos it ion__timeout_PTS" describes an ending time of 
an interactive display by means of buttons . At the ending 
time, display of the interactive display is no more valid, 
and therefore is not presented. compos it ion_timeout_PTS is 
preferably described in a time accuracy of the reproduction 
time axis for the motion picture data. 

*selection_timeout_PTS" describes an ending time of 
a valid button selection period. At the time shown by the 
selection_timeout_PTS , a button specified by 

def ault__activated_button__number gets activated . 

selection_timeout_PTS is equal to the time specified by 
compos it ion_timeout_PTS or shorter . 

selection_timeout_PTS is described in a time accuracy of a 
video frame. 

XN UO_mask_table" indicates permission/non-permission 
of a user operation in a Display Set corresponding to an ICS. 
When XN non-permission" is set in this mask field, any user 
operation directed to a reproduction apparatus becomes 



invalid . 

xx an imation_f rame__r at e_code" describes a frame rate to 
be applied to a button displayed in animation . The animation 
frame rate is given by dividing the video frame rate by a 
5 value of this field. If this field indicates a value of 00, 
only ODS identified by start_ob j ect_id_xxx is displayed and 
in non-animation, among the ODS defining graphics objects 
for all the buttons . 

"def ault_selected_button_number " indicates a button 

10 number whose default is to be set in a selected state at the 
start of an interactive display. When this field indicates 
0, the button assigned a button number stored in the register 
of a reproduction apparatus is set to be an active state 
automatically. If this field indicates other than 0, the 

15 field is interpreted to identify a corresponding button. 

"def ault_activated_button_number " indicates a button 
to be set in active state automatically, in a case when a 
user has not set any button in active state within the time 
defined by the selection_timeout_PTS . When the 

20 default_activated_button_number indicates XX FF" , the button 
currently in selected state is automatically selected at the 
time defined by the selection_timeout_PTS . When the 
def ault_activated_button__n umber indicates "00" , the 
automatic selection is not performed. When the 

25 defaut_activated_button_number indicates other than "00" 
and "FF", then this field is interpreted to identify a 
corresponding button . 

"button information (button_info ) " is information 



def ining each button to be overlayed in an interactive display 
In the drawing, the leader line hpl helps clarify the internal 
structure of the button information i, which is information 
about the ith button to be controlled by the ICS (button i) . 
The following is an explanation on information elements 
constituting this button information i. 

"button_number" is a numerical value uniquely 
identifying a button i in an ICS. 

"numerically_selectable_f lag" is a flag indicating 
whether a numerical -value selection is permitted for the 
button i . 

NV auto_action_f lag" indicates whether to automatically 
set the button i to be active state. When auto_action_f lag 
is set to be ON (i.e. bit value of 1), the button i is set 
to be in active state, instead of selected state. When the 
auto_action_f lag is set to be OFF (i.e. bit value of 0 ) , the 
button i will be in mere selected state even when the button 
i is actually selected. 

"ob ject_horizontal_position" , xx ob ject_vertical_posi 
tion" respectively indicate a horizontal position and a 
vertical position of the upper left pixel of the button i 
in an interactive display. 

vx upper_button_n umber " indicates a button number to be 
in selected state, instead of the button i, when the MOVEUP 
key is pressed while the button i is in selected state. If 
the number for the button i is set in this field, the press 
of the MOVEUP key is ignored. 

NX lower_button_number" , xx lef t_button_n umber " , and 



NX right_button_number" respectively indicate the button 
numbers to be in selected state, instead of the button i, 
when the MOVEDOWN key, the MOVELEFT key, the MOVERIGHT key 
are pressed while the button i is in selected state. When 
the number for the button i is set in this field, the press 
for these keys is ignored. 

XN start_object_id_normal" indicates the first number 
of serial numbers assigned to a plurality of ODSs constituting 
animation, when the button i in normal state is to be drawn 
in animation. 

VN end_ob ject_id_normal" indicates the last number of 
the object_id being the serial numbers assigned to the 
plurality of ODSs constituting the animation , when the button 
i in normal state is to be drawn in animation. If the ID 
indicated by this end__ob j ect__id_normal is identical to the 
ID. indicated by the start_ob j ect_id_normal , then the still 
image corresponding to a graphics object identified by this 
ID will be the image design of this button i. 

vx repeated_normal__f lag" indicates whether to 
repeatedly continue the animation display for the button i 
in normal state. 

n start_ob j ect_id__selected" indicates the first number 
of the serial numbers assigned to the plurality of ODSs 
constituting animation, when the button i in selected state 
is drawn in animation. If the ID indicated by 

end_ob j ect_id_selected is identical to the ID indicated by 
this start_object_id_selected, then the still image 
corresponding to a graphics object identified by this ID will 
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be the image design of this button i. 

"end_object_id_selected" indicates the last number of 
the object_id being the serial numbers assigned to the 
plurality of ODSs constituting the animation. 
5 vv repeat__selected_f lag" indicates whether to 

repeatedly continue the animation display for the button i 
in selected state. When start_ob j ect_id_selected has the 
same value as end_ob j ect_id_selected , 00 is set in this field . 

yv start_ob j ect_id_act ivated" indicates the first 
10 number of the serial numbers assigned to the plurality of 
ODSs constituting animation , when the button i in active state 
is drawn in animation. 

"end_obj ect__id_act ivated" indicates the last number 
of object_id being the serial numbers assigned to the 
15 plurality of ODSs constituting animation, when the button 
in active state is drawn in animation. 

Next, the button commands are explained. 

"button command (button_command) " indicates a command 
to be executed when the button i is put into active state. 
2 0 The button command can instruct a reproduction 

apparatus to perform reproduction directed to PL and Playltem . 
A command that instructs a reproduction apparatus to perform 
reproduction directed to PL and Playltem is called "LinkPL 
command" . This command can start reproduction of a playlist 
25 specified by a first argument, from a position specified by 
a second argument . 



Format : LinkPL ( f irst argument , second argument ) 
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The first argument specifies, by means of a number 
assigned to a playlist, a PL to be reproduced. The second 
argument specifies a reproduction start position, by means 
of a Playltem included in the PL, or a chapter and a mark 
that are included in the PL. 

A LinkPL function for specifying a reproduction start 
position by means of Playltem is expressed as 
xx LinkPLatPlayItem( ) " . 

A LinkPL function for specifying a reproduction start 
position by means of Chapter is expressed as 
>x LinkPLatChapter ( ) " . 

A LinkPL function for specifying a reproduction start 
position by means of Mark is expressed as XN LinkPLatMark ( ) " . 

A button command is used to give instructions to a 
reproduction apparatus to perform a state obtaining and a 
state setting. A state of a reproduction apparatus is 
indicated by 64 Player Status Registers (whose set value is 
called PSR) , and 4096 General Purpose Registers (whose set 
value is called GPR) . The button command is classified into 
the following (i)-(iv), and performs setting of a value to 
these registers, and obtaining of a value from these 
registers . 

(i) xx Get value of Player Status Register" command 

Format: Get value of Player Status Register (argument) 
This function is used when obtaining a set value of 

a Player Status Register specified by an argument. 
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(ii) "Set value of Player Status Register'' command 
Format: Set value of Player Status Register (first 
argument, second argument) 

The function is used when setting a value specified 
by a second argument to a Player Status Register specified 
by a first argument. 

(iii) "Get value of General Purpose Register" command 
Format: Get value of General Purpose Register 
(argument) 

This function is used when obtaining a set value of 
a General Purpose Register specified by an argument. 

(iv) "Set value of General Purpose Register" command 
Format: Set value of General Purpose Register (first 
argument, second argument) 

This function is used when setting a value specified 
by a second argument to a General Purpose Register specified 
by a first argument. 

Next, a concrete example of interactive control 
performed by such an ICS is explained . This concrete example 
assumes the ODSs and the ICS as shown in FIG. 12. FIG. 12 is 
a diagram illustrating a relation between ODSs in a DSn, and 
an ICS. This DSn is supposed to include 0DS11-19, 21-29, 
31-39, and 41-49. Among these ODSs , ODS11 - 19 draw each state 
of a button A. ODS21-29 draw each state of a button B. 



ODS31-39 draw each state of a button C, and ODS41-49 draw 
each state of a button D ( as shown by a sign vx } " in the drawing ) . 
In addition, button_inf o ( 1 ) ,(2), (3), (4) respectively 
indicate the state control of these buttons A-buttons D ( Refer 
*5 to the arrows bhl,2,3,4 in the drawing). 

When the execution timing of the control by means of 
this ICS coincides with a display timing of any picture data 
ptl, which is among the pictures of FIG. 13, an interactive 
display tml made of buttons A-D is displayed (gs2) by being 

10 overlayed (gsl) with this picture data ptl. An interactive 
display made of a plurality of buttons is displayed in 
accordance with the content of a motion picture. Therefore 
an ICS can realize realistic effect with use of buttons. 

FIG . 14 illustrates a description example of an ICS when 

15 the state transition of the buttons A-D (shown in FIG. 15) 
is performed. 

In FIG. 15, arrows hhl and hh2 symbolically represent 
a state transition by means of neighbor_inf o ( ) of button 
info(l) . In the neighbor_info( ) of the button info(l) , the 

20 lower_button_number is set as "button C" , and so the button 
C will be in selected state ( s j 1 of FIG . 15 ) if an UO of MOVEDOWN 
key press occurs while the button A is in selected state (upl 
of FIG. 15). In the neighbor_inf o ( ) of the button info (1)/ 
the right_button_number is set as "button B" , and so the button 

2 5 B will be in selected state ( s j 2 of FIG . 15 ) if an UO of MOVERIGHT 
key press occurs while the button A is in selected state (up2 
of FIG . 15 ) . 

The arrow hh3 in FIG. 15 indicates a state transition 



control by means of neighbor_inf o ( ) of the button info (3) . 
In the neighbor_inf o ( ) of the button info (3), 
upper_button_number is set as "button A" , and so the button 
A will return to the selected state if an UO of MOVEUP key 
press occurs while the button C is in selected state (up3) . 

Next, the image designs of the buttons A-D are described . 
Suppose here that ODS11 , 21, 31, and 41 have the image designs 
shown in FIG . 16 , and that the ODS11-19 assigned to the button 
A have the image designs shown in FIG. 17. Because, in the 
normal_state_inf o ( ) in the button_info (1) of the ICS, 
start_ob j ect_id_normal and end_ob j ect_id_normal specify 
ODS11-13 , and so the normal state of the button A is presented 
in animation according to the ODS11-13 . In addition, in the 
selected_state_inf o ( ) of the button_inf o ( 1 ) , 

start_ob j ect_id_selected and end_ob j ect_id_selected 
specify ODS14-16, and so the selected state of the button 
A is presented according to the ODS14-16. When a user puts 
the button A into selected state, the image design of the 
button A will change from the design according to the 0DS11- 13 , 
to the design according to the ODS14-16. Here, in the 
normal_state_inf o ( ) and the selected_state_inf o ( ) , if the 
repeat_normal_f lag and repeat_select_f lag , are set as 1, the 
animation according to the ODS11-13 and the animation 
according to the ODS14-16 will be repeatedly continued 
respectively, as shown by ^(A)", *(A)-", and V -(B)\ XV (B)-/' 
in the drawing . 

If a plurality of ODSs presentable in animation are 
assigned to the buttons A-D, and that the control for these 



ODS is described in the ICS, realistic- looking button state 
control will be realized (e.g. to change the expression of 
a character according to each user operation) . 

Next, application of numerically_selectable_f lag is 
described. 

FIG. 18 is a diagram illustrating one example of ICS 
and ODS included in a DS . In this drawing, the ODS31-33 
respectively indicate a portrait , a name, and a uniform number 
of a corresponding one of three baseball players shown in 
the top row of the drawing. The ICS to which this DS belongs 
includes three sets of button information, where the button 
information (1) ' s start_obj ect__id is set to indicate the ODS31 , 
the button information (2)'s start__ob j ect_id is set to 
indicate the ODS32, and the button information (3)'s 
start_ob ject_id is set to indicate the ODS33. In addition, 
the button information (1) 's button number is set as 99, the 
button information (2)'s button information is set as 42, 
and the button information (3) 's button information is set 
as 94 . Furthermore, for all the button information (l)-(3), 
the numerically_selectable_f lag is set as 1 . This means that 
any of the buttons corresponding to the button information 
(l)-(3) is selectable. Therefore if the numerical value of 
"99" is inputted by a user through the remote controller 400, 
the button corresponding to Mr. Beginner's Luck will be put 
to selected state. The input of the numerical value "99" 
may be received through sequential press of "9" and "9". 
Alternatively, it may be realized by a combination of a press 
of "9" and 9 times of press directed to "4-10" key. When the 



numerical value of M2" is inputted, the button for Mr. 
Careless Mistake will be put to selected state, and when the 
numerical value of xx 94" is inputted, the button for Mr. Dead 
Stock will be put to selected state. 

When auto_action_f lag for these pieces of button 
information (l)-(3) are set as 1, these pieces of button 
information (l)-(3) will be put to active state, instead of 
put to selected state, and the button commands included 
therein, namely (LinkPL(PL#21) , LinkPL(PL#22 ) , 

LinkPL(PL#2 3 ) ) will be executed. When the link destinations 
PL#21, #22, and #23 of the button commands, included in the 
three pieces of button information, are batting/throwing 
scenes of respective players, then these batting/throwing 
scenes will be reproduced in response to an input of a numerical 
value corresponding to the uniform number of a corresponding 
player . Since it is possible to select buttons directly using 
a uniform number that is well-known, the user operability 
will remarkably improve. 

Next, the order of ODSs in a Display Set is described. 
As described above, each ODS belonging to a Display Set is 
specified by an ICS to display one state of a button. The 
order of ODSs in a Display Set is decided according to such 
a specification, i.e. which state of a button an ODS 
represents . 

To be more specific, ODSs in a Display Set are classified 
into sets of (1) those representing normal state, (2) those 
representing selected state, and (3) those representing 
active state. A set of ODSs that represents one state of 



a particular button is called ^button-state set" . These 
button-state sets are disposed in the order of "normal 
state— selected state—active state". As shown above, the 
order of each ODS in the Display Set is decided according 
5 to which state of a button the ODS represents . 

FIG. 19 is a diagram illustrating the order of ODSs 
belonging to a Display Set . In the second row of this drawing , 
three button- state sets in the Display Set are illustrated. 
This drawing depicts : a set of ODSs for rendering normal state 

10 of the buttons (ODSs for Normal state); a set of ODSs for 
rendering selected state of the buttons (ODSs for Selected 
state) ; and a set of ODSs for rendering active state of the 
buttons (ODSs for Active state). The order of these 
button-state sets is as follows: normal state— selected 

15 state— active state. The purpose of this order is for 
facilitating reading of the ODSs constituting an initial 
display of an interactive display early, putting off the 
reading of the ODSs constituting a screen display after 
update . 

20 The first row of FIG. 19 represents graphics objects 

An, Bn, Cn, Dn , As, Bs, Cs, Ds , Aa, Ba, Ca, Da, which will 
be rendered by these button-state sets. The subscript vx n" 
assigned to An,Bn,Cn,Dn represents normal state of a 
corresponding button. In the same manner, the subscript xx s" 

25 of As,Bs,Cs,Ds represents selected state of a corresponding 
button, and the subscript vx a" represents active state of a 
corresponding button. The second row of FIG. 19 shows 
button-state sets to which the Graphics Objects of the first 



row belong. It should be noted that, in this drawing, the 
sets of ODSl-ODSn respectively belonging to N-ODSs, S-ODSs, 
and A-ODSs are assigned the same number to each other, (i.e. 
there is 0DS1 belonging to N-ODSs , and at the same time, there 
is ODS1 belonging to S-ODSs. ) . However, each set is different 
from one another . This also applies to every similar drawing 
hereinafter . 

FIG. 20 is a drawing illustrating a state transition 
of an interactive display at which the button-state sets of 
FIG. 19 are disposed. 

The interactive display in this drawing has a plurality 
of states, namely, "initial display" , "update display by 1 st 
user action", and "update display by 2 nd update display". 
The arrows in the drawing represent user actions that trigger 
the state transition. By this drawing, the four buttons A, 
B, C, and D respectively have three states of "normal state" , 
"selected state", and "active state". Among them, what is 
necessary for an initial display is three graphics objects 
for rendering a normal state and one graphics object for 
rendering a selected state. 

Even when the default selected button is not decided 
yet, and it is uncertain which of the buttons A-D will be 
put to selected state, an initial display can be realized 
when decodingof graphics obj ect representing the normal state 
and the selected state of each button has been complete. In 
view of this, in the present embodiment, the button- state 
sets are disposed in the order of "normal state— selected 
state— active state" as the second row of FIG. 19 shows. 



According to this disposition of button-state sets, initial 
display can be realized even when the reading and decoding 
of ODSs constituting active state has not yet been complete, 
and it becomes also possible to shorten a time period between 
5 the reading start of a Display Set and completion of an initial 
display . 

Next, the order in which the ODSs shown in FIGs.16 and 
17 should be disposed is explained. FIG. 21 is a diagram 
illustrating the order of ODSs in a Display Set. In this 

10 drawing, ODSs for Normal state is composed of ODS11-13, 
ODS21-23, ODS31-33, ODS41-43. ODSs for Selected state is 
composed of ODS14-16, ODS24-26, ODS34-36, and ODS44-46. 
Finally, ODSs for Active state is composed of ODS17-19, 
ODS27-29, ODS37-39, and ODS47-49. ODS11-13 are for 

15 rendering expression change of a character as shown in FIG . 17 , 
and the same thing can be said to the ODS21-23 , the ODS31-33 , 
andODS41-43 . Therefore, by disposing these ODSs in the first 
button-state set, preparation for an initial display can be 
made even during reading of the Display Set. By the above 

20 arrangement, it becomes possible to perform an interactive 
display to which animation is incorporated, without delay. 

Next, the order of ODSs to be referenced by a plurality 
of button states (multi-reference) is explained. 
Multi-reference means that object__id of one ODS is specified 

25 by twoormore sets of normal_state_inf o , selected_state_inf o, 
and activated_state_inf o . By such multiple-reference, it 
becomes possible to use a graphics object for rendering the 
normal state of a button, for rendering another button's 



selected state. This means that it is possible to share the 
design image of one graphics object. Such sharing helps 
reduce the number of ODSs . Here, it is problematic which 
button-state set an ODS to be multiple-referenced should be 
made to belong. 

For example, suppose when a normal state of a button 
and a selected state of another button are drawn by one ODS . 
Then it is problematic whether this ODS belongs to a 
button-state set corresponding to Normal state, or a 
button-state set corresponding to Selected state. 

In principle, this ODS will be disposed only in a 
button-state set that corresponds to an earliest-appearing 
state among the plurality of states. 

For instance, when an ODS is multiple-referenced by 
a normal state and a selected state, the ODS will be disposed 
in a button-state set for Normal state (N-ODSs), not in a 
button-state set for Selected state ( S-ODSs ) . In a different 
example, if an ODS is multipe-ref erenced by a selected state 
and an active state, then the ODS will be disposed in a 
button-state set for Selected state (S-ODSs), and not in a 
button-state set for Active state ( A-ODSs ) . In this way, a 
multiple-referenced ODS is disposed only in a button-state 
set corresponding to the earliest appearing state. 

Next, the order of ODSs in S-ODSs is explained. In 
S-ODSs, which ODS comes first depends on whether the default 
selected button is statically determined or dynamically 
determined. A statically-determined default selected 
button is a button specified by a valid value (other than 



00) set in def ault_selected_button_number in the ICS. When 
a valid value other than 00 is set as the 
def ault_selected_button__n umber , and that no ODS 
representing a default selected button does not exist in the 
N-ODSs, the ODS representing the default selected button is 
disposed at the beginning of the S-ODSs. 

When the def ault_selected_button_number indicates a 
value of 00, then the button to be set in selected state, 
as a default, will dynamically change depending on the state 
at a reproduction apparatus side. 

The case where the default_selected„button_number is 
set to indicate the value 00 includes a case when the AV Clip 
onto which the Display Set has been multiplexed exists at 
a joint point of a plurality of reproduction paths. For 
example , suppose a case when the preceding reproduction paths 
are respectively first, second, and third chapters, and the 
Display set at the joint point is for displaying buttons 
corresponding to the first, second, and third chapters . In 
such a case, it is not appropriate to predetermine the button 
to be in selected state as a default, by the 
def ault_selected_button_number . 

In such a case, it is ideal to change the button to 
be in selected state according to which one of the preceding 
plurality of reproduction paths has been passed, until 
reaching this Display Set (e.g. the second- chapter button 
when reaching from the first chapter, the third-chapter button 
when reaching from the second chapter, and the fourth- chapter 
button when reaching from the third button) . In a case where 



the button to be in selected state changes depending on the 
preceding reproduction path, the 

default_selected_button_number will be set to 
indicate "invalid" , i . e . the zero value is set thereto . Since 
the button to be in selected state will change, an arrangement 
of disposing a certain ODS at the beginning of the button- state 
set is not performed. 

FIG . 22 is a diagram illustrating difference in the order 
of ODSs in a S-ODSs, between a case when 
default_selected_button_number indicates xv 0", and when it 
indicates ''button B" . In this drawing, the broken line ssl 
indicates the order of ODSs in the S-ODSs when 
default_selected_button_number indicates the button B, and 
the broken line ss2 indicates the order of ODSs in the S-ODSs 
when def ault_selected_button_number indicates 0 . As shown 
in the representation of this drawing, when 
default__selected_button_number indicates the button B, the 
ODSBs indicating the selected state of the button B is placed 
at the beginning of S-ODSs, with the other buttons ' ODSs being 
placed thereafter. On the other hand, when 

def ault_selected_button_number indicates 0, the ODSAs 
indicating the selected state of the button A is placed at 
the beginning of the S-ODSs. In this way, whether the 
default_selected_button_number is valid or not affects the 
order of ODSs within the S-ODSs. 

Next, how a Display Set having such ICS and ODS is 
assigned to a reproduction time axis of an AVClip is described . 
An Epoch is a period during which memory management continues 



on the reproduction time axis. Since an Epoch is composed 

of one or more Display Sets, it is an issue how to assign 

Display Sets to the reproduction time axis of the AV Clip. 

Here, the reproduction time axis of an AV Clip is used to 
5 define decode/reproduction timing of each piece of picture 

data constituting a video stream multiplexed into an AV Clip . 

In this reproduction time axis, a decode timing and a 

reproduction timing are expressed in a time accuracy of 9 OKHz . 

DTS and PTS assigned to these ICS and ODS in a Display Set, 
10 indicate a timing to realize synchronized control on this 

reproduction time axis. Synchronized control by means of 

DTS and PTS assigned to ICS and ODS is assigning of Display 

Set to the reproduction time axis. 

First, what kind of synchronized control is performed 
15 by means of DTS and PTS assigned to ODS is described. 

A DTS indicates a decode start time for an ODS, in a 

time accuracy of 90KHz. A PTS indicates a decode end time 

for an ODS . 

Decoding of an ODS does not end in an instant, and takes 
20 a certain time to complete. 

So as to clarify the start point/end point, a DTS and 
a PTS respectively indicate a decode start time and a decode 
end time, for an ODS. 

Since the value of a PTS indicates an ending time, it 
25 is necessary that the decoding of ODS j has been complete before 
the time shown by the PTS, and that the decompressed graphics 
object should be obtained in the object buffer of a 
reproduction apparatus by then. 



Since the decode start time of an arbitrary ODSj 
belonging to a Display Set XN n" is expressed as DTS(DSn[ODS] ) 
in a time accuracy of 9 0KHz, the time obtained by adding a 
maximum time required for the decoding to this decode start 
5 time will be the guaranteed decode end time of the ODSj of 
the Display Set. 

Assume that the size of ODSj after decompression is 
SIZE(DSn [ODSj ] ) , and the decode rate of the ODS is Rd . Then 
the maximum ' time required for decoding will be 
10 SIZE(DSn [ODSj ] ) //Rd . 

Note that the operator V V/" used here is a division 
in which decimals are raised to the next whole number. 

This maximum time is converted into a time accuracy 
of 9 OKHz , and added to the DTS of ODSj. In this way, the 
15 decode end time ( 90KHz ) to be indicated by the PTS is obtained . 

The PTS of ODSj belonging to the DSn is expressed as 
follows. 

PTS(DS [ODSj ]=DTS( DSn [ODSj ] ) +90 , 000* ( SI ZE ( DSn [ODS j ] ) )// 
2 0 RD) 

Then between the two ODS (ODSj, ODSj+1) , the following 
relation should be satisfied. 

25 PTS(DSn[ODSj ] ) <DTS (DSn [ODS j+1] ) 



Next, the PTS value of an ICS is explained. 
If immediately after an Epoch start, the PTS of an ICS 
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is set after a value obtained by adding: (1) PTS value of 
ODS whose decode time finishes the last among the ODSs 
constituting the initial display of the DSn; (2) a time 
required to clear a graphics plane; and (3) a write time 
required to write a graphics object obtained by decoding of 
ODSs, to the graphics plane. 

On the other hand, if at an Acquisition Point, the PTS 
of an IDS is set after a value obtained by adding (1) and 
(3) . 

If def ault_selected_button_number is indicated by an 
ICS, preparation for an initial display will be ready when 
the decoding of ODSs for rendering the normal state of all 
the buttons and the decoding of ODSs for rendering the selected 
state of the default button have been complete. The ODSs 
for rendering the selected state of a plurality of buttons 
presented in an initial display are called "S-ODSs", and the 
ODS in the S-ODSs whose decode time finishes the earliest 
is called vv S~ODSsf irst" (in this case, the ODS for rendering 
the default button) . The PTS value of the S-ODSsfirst is 
set as a PTS value of the ODS whose decode time finishes the 
last, and is used as a reference value of the PTS of the ICS. 

If def ault_selected_button_number is not indicated by 
an ICS , it is not known which button will be in selected state . 
And so, preparation for an initial display is not complete 
until preparation for rendering the normal state and the 
selected state of all the buttons gets ready. Of all the 
S-ODSs for rendering the selected state of the plurality of 
buttons required in the initial display, the ODS whose decode 



time finishes the last is called "S-ODSslast" . The PTS value 
of this S-ODSslast is set as a PTS value of the ODS whose 
decode time finishes the last, and is used as a reference 
value of the PTS of the ICS. 

Suppose that the decode end time of the S-ODSsfirst 
is expressed as PTS (DSn [S-ODSsf irst ] ) . Then the 

PTS(DSn[ICS] ) is obtained by adding (2) and (3), to 
PTS(DSn[S-ODSsf irst] ) . 

Suppose that the widthwise size of a rectangular area 
in which drawing is possible in a graphics plane is expressed 
as "video_width" , and the lengthwise size thereof is expressed 
as "video_height" . Also suppose that the write rate to a 
graphics plane is 12 8Mbps. Under these presumptions, the 
amount of time required to clear a graphics plane is expressed 
as 8*video_width*video_height//128 ,000,000. 

If this is expressed in a time accuracy of 90KHz, then (2) 
a time required to clear the graphics plane is expressed as 
90, 000 (8*video_width*video_height//12 8, 0 00 , 00 0) . 

Also suppose that the total size of the graphics objects 
specified by all the button information included in an ICS 
is expressed as £SIZE(DSn [ics . BUTTON [ i ] ] ) , and a write rate 
to a graphics plane is 128Mbps. Then the time required to 
write to the graphics plane is expressed as 
£SIZE (DSn[ ICS. BUTTON [i] ] ) //128 , 000 , 000 . If this is 

expressed in a time accuracy of 90 KHz, the time required 
to clear the graphics plane is expressed as 
90, 0 00 *( SSI ZE (DSn [ICS. BUTTON [i] ] )//12 8 , 000 , 000 ) . . 

Here, £SIZE ( DSn [ ICS . BUTTON [ i ] ] ) indicates a total size 



for the first display object of the graphics objects 
representing a button. This £SIZE ( DSn [ ICS . BUTTON [ i ] ] ) 
yields a different value between a case where the default 
selected button is decided and a case where it dynamically 
5 changes. When the default selected button is statically 
decided, 2SIZE ( DSn [ ICS . BUTTON [ i ]] ) will yield a total size 
of : a first displayed one of ODSs that represent the selected 
state of a default selected button; and a first displayed 
one of ODSs that represent the normal state of the buttons 

10 other then the default selected button. 

Next, when the default selected button dynamically 
changes , it is not known which button will be a selected button . 
Therefore it is necessary to assume the case that has the 
longest writing time. Here, between a graphics object 

15 representing a first page of the normal state of an arbitrary 
button x (ODSnl) , and a graphics object representing a first 
page of the selected state of the button x (ODSsl), the one 
that has a larger size (Max ( ODSnl , ODSsl ) ) is considered as 
a graphics object to be displayed first for the button x. 

20 The result obtained by adding together Max ( ODSnl , 

ODSsl) forall the buttons will be £SIZE (DSn [ ICS . BUTTON [ i ] ] ) . 

FIG.23A and FIG.23B are diagrams for showing the 
concrete value for £SIZE(DSn [ICS . BUTTON [ i ] ] ) , in a case when 
N-ODSs include a plurality of ODSs constituting the buttons 

25 A-D, and S~ODSs include a plurality of ODSs constituting the 
buttons A-D . Here, when the def ault_selected__button_n umber 
indicates a valid value, £SIZE (DSn [ ICS . BUTTON [ i ] ] ) will be 
a total size of four ODSs shown by thick frames. vx Asl" is 



a firstly displayed one of a plurality of ODSs representing 
the selected state of the button A. XN Bnl", "Cnl", and xx Dnl" 
are respectively the firstly displayed one of a plurality 
of ODSs representing the normal state of the buttons B-D. 
When these sizes are expressed by XN size()", then 
£SIZE(DSn[ICS.BUTTON[i] ] ) will be expressed as 
size( Asl) +size(Bnl) +size(Cnl )+size(Dnl ) . 

On the other hand, when the 

def ault_selected_button_number is 0, the total of: a larger 
ODS of Anl and Asl; a larger ODS of Bnl and Bsl; a larger 
ODS of Cnl and Csl; and a larger ODS of Dnl and Dsl, will 
be £SIZE(DSn[ICS.BUTTON[i] ] ) . 

Therefore, £SIZE ( DSn [ ICS . BUTTON [ i ]] ) is expressed as 
follows . 

£SIZE (DSn [ICS . BUTTON [i] ] )= max ( (size (Anl) , (size 

Asl) ) 

+max( ( size(Bnl) , ( size Bsl )) +max( ( size (Cnl ),( size Csl)) 
+max( ( size(Dnl) , (size Dsl)) 

Then PTS (DSn [ICS] ) at immediately after the Epoch Start 
will be expressed as follows, using the above expressions: 
PTS (DSn [ICS] )>PTS(DSn[S-ODSsfirst] ) 
+90, 000*(8*video_width*video_height//128, 000, 000) 
+9 0 , 000* (2SIZE (DSn [ICS .BUTTON [i] ]) 12 8, 000, 000) 

On the other hand, when the 

def ault__selected__button_number is invalid, it is only 
necessary to replace PTS (DSn [S-ODSsf irst ] ) with 



PTS (DSn [S-ODSslast] ) . The concrete expression will be as 
follows : 

PTS(DSn[ICS] )>PTS(DSn [S-ODSslast] ) 
+90 , 000* ( 8*video_width*video_height//128 , 000 , 000 ) 
+9 0, 000* (£SIZE( DSn [ICS .BUTTON [i] ]) 12 8,000,000) 

FIG. 24 shows one example of realizing synchronized 
display by setting PTS and DTS in the above way. In this 
diagram, assumption is made such that a button is displayed 
at a display timing of arbitrary picture data vv pyl" which 
is in the motion picture in this drawing. In this case, the 
PTS value of the ICS should be set so as to coincide with 
the display timing of this picture data. 

Decoding of the ODS whose decode time finishes the last, 
among the ODSs constituting the initial display of the DSn, 
should be complete by the time obtained by subtracting, from 
the PTS of the ICS, the screen-clearing period cdl and the 
graphics-object transfer period tdl . Therefore the PTS 
value of the ODS should be set at the timing (^1) shown in 
this drawing. Furthermore, the decoding of the ODS takes 
the period ddl, and so the DTS value of this ODS should be 
set at the ddl period earlier than this PTS. 

In FIG. 24, there is only one ODS to be overlayed with 
the motion picture, which is a simplified case . If the initial 
display of the interactive display to be overlayed with the 
motion picture is realized by a plurality of ODSs, PTS and 
DTS of the ICS, and PTS and DTS of ODS should be set as in 
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FIG. 25. 

FIG. 25 is a diagram showing how to set DTS and PTS, 
in a case when a plurality of ODSs compose the initial display 
of the interactive display, and the default selected button 
is statically decided. If the decoding of the ODS whose 
decoding takes the longest in S-ODSsfirst (the ODSs for 
realizing the initial display) finishes when the time ddl 
has passed in the drawing, then the PTS of this S-ODSsfirst 
(DSn [S-ODSsf irst ] ) is set to indicate the time at which the 
period ddl has passed. 

Furthermore , it is necessary to perform screen clearing 
and transferring of decoded graphics objects, for realizing 
initial display. Therefore, the PTS of the ICS (DSn [ICS]) 
should be set after the time obtained by adding, to the value 
of this PTS (DSn [S-ODSsfirst] ) , a period required to perform 
screen clearing 
(90, 000*(8*video_width*video_height//128, 000, 000) ) , and 
transferring time of decoded graphics object 
(90, 000* (£SIZE( DSn [ICS. BUTTON [i] ]) 12 8, 000,000)). 

FIG. 26 is a diagram showing how to set DTS and PTS, 
in a case when a plurality of ODSs compose the initial display 
of the interactive display, and the default selected button 
is not decided. If the decoding of the S-ODSslast, whose 
decoding takes the longest in S-ODSs for realizing the initial 
display, finishes when the time dd2 has passed in the drawing, 
then the PTS of this S-ODSslast (DSn [S-ODSslast] ) is set to 
indicate the time at which the period dd2 has passed. 

Furthermore, so as to realize an initial display, it 



is necessary to perform screen clearing, and transferring 
of decoded graphics object. Therefore the PTS(DSn[ICS] ) of 
the ICS should be set after the time obtained by adding, to 
the value of this PTS (DSn [S-ODSslast] ) , a period required 
to perform the screen 

clearing (90, 000* ( 8*video_width*video_height//12 8 , 000, 000 
) and transferring time of decoded graphics object 
(90, 00 0* (£SIZE( DSn [ICS. BUTTON [i] ] ) 128 , 000 , 000 ) ) . 

In a DVD, a period during which an interactive control 
is valid corresponds to a period of a VOBU, which functions 
as a GOP of the video stream. However, in a BD-ROM, such 
a valid period can be set arbitrarily by means of PTS and 
DTS in ICS included in an Epoch. Therefore the interactive 
control by means of a BD-ROM is not in dependence relation 
with a GOP. 

Note that a synchronized control by means of a PTS of 
an ICS is not limited to perform control so as to display 
a button at a certain timing on a reproduction time axis, 
and also includes performing of control so as to enable display 
of a Popup menu during a certain period on a reproduction 
time axis . A Popup menu is a menu that will be popped up 
on a screen, by a press of a menu key provided for the remote 
controller 400, and the synchronized control by means of PTS 
of ICS also include enabling of display of such a Popup menu 
at a display timing of certain picture data in an AV Clip. 
The ODSs constituting a Popup menu are decoded and a graphics 
object obtained by the decoding are written to a graphics 
plane, just as the ODSs constituting a button. Unless the 
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writing to a graphics plane is not complete , it is not possible 
to respond to a menu call by a user. In view of this, a time 
at which the Popup display becomes possible is indicated by 
the PTS of ICS, in performing synchronized display of a Popup 
menu . 

The data structure of a Display Set ( ICS , PDS , ODS ) , 
described so far, is an instance in a class structural body 
written in a programming language. A producer who performs 
authoring is able to obtain the structures on a BD-ROM, by 
describing this class structural body. 

Next, an embodiment of a reproduction apparatus 
according to the present invention is explained. FIG. 27 is 
a diagram showing the internal structure of a reproduction 
apparatus according to the present invention. The 
reproduction apparatus according to the present invention 
is produced industrially based on the interior shown in this 
drawing. The reproduction apparatus of the present 
invention is mainly composed of three parts: a system LSI, 
a drive apparatus, and a micro system. The industrial 
production is pursued by implementing these parts to the 
cabinet and to the substrate of the reproduction apparatus . 
The system LSI is an integrated circuit onto which varieties 
of processing units, having functions of the reproduction 
apparatus, are integrated. The reproduction apparatus 
produced in such a way is comprised of: a BD drive 1, a track 
buffer 2, a PID filter 3, a transport buffers 4a, b, and c, 
a peripheral circuit 4d, a video decoder 5, a video plane 
6, an audio decoder 7, a graphics plane 8, a CLUT unit 9, 



an addition device 10, a graphics decoder 12, a coded data 
buffer 13, a peripheral circuit 13a, a stream graphics 
processor 14, an object buffer 15, a composition buffer 16, 
a graphics controller 17 , a UO controller 18 , a player register 
group 19, and a control unit 20. 

The BD-ROM drive 1 executes access to the BD-ROM by 
performing loading/reading/ejecting for a BD-ROM. 

The track buffer 2 is a FIFO memory , and stores TS packets 
read from the BD-ROM, on a first-in first-out basis. 

The PID filter 3 performs filtering to a plurality of 
TS packets outputted from the track buffer 2 . The filtering 
by the PID filter 3 is to write only TS packets having a desired 
PID, to the transport buff ers 4a, b, andc, and does not require 
buffering. Therefore the TS packets inputted to the PID 
filter 3 will be written to the transport buffers 4a, b, and 
c, without time-delay. 

The transport buffers 4a, b, and c are respectively 
a memory for storing TS packets outputted from the PID filter 
3, on a first-in, first-out basis. 

The peripheral circuit 4d is a wire logic that performs 
processing to convert TS packets read from the transport 
buffer 4a, into functional segments. The functional 
segments obtained by the conversion are stored in the coded 
data buffer 13 . 

The video decoder 5 decodes a plurality of TS packets 
outputted from the PID filter 3 to obtain decompressed 
pictures, and write them to the video plane 6. 

The video plane 6 is a plane for motion pictures. 
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The audio decoder 7 decodes the TS packets outputted 
form the PID filter 3 to obtain decompressed audio data, and 
outputs the decompressed audio data. 

The graphics plane 8 is a memory having an area 
corresponding to one screen , and is able to store decompressed 
graphics for one screen. 

The CLUT unit 9 converts index colors of the decompressed 
graphics stored in the graphics plane 8, based on the Y, Cr, 
Cb values shown by the PDS . 

The addition device 10 multiplies the decompressed 
graphics resulted from color conversion at the CLUT unit 9 , 
with a T value (transmission rate) shown by the PDS, and adds 
the result and the decompressed picture data stored in the 
video plane 6, pixel by pixel, to obtain an overlayed image, 
and outputs the overlayed image . 

The graphics decoder 12 decodes a graphics stream, to 
obtain decompressed graphics, and writes this decompressed 
graphics to the graphics plane 8, as a graphics object. By 
decoding of the graphics stream, subtitles and menus will 
appear on a screen. This graphics decoder 12 is comprised 
of a coded data buffer 13, a peripheral circuit 13a, a stream 
graphics processor 14, an object buffer 15, a composition 
buffer 16, and a graphics controller 17. 

The coded data buffer 13 is a buffer in which the 
functional segments are stored together with DTS and PTS . 
Such functional segments result from removing a TS packet 
header, and a PES packet header from each TS packet in a 
transport stream stored in the transport buffer 4a, and then 



disposing the payloads sequentially. Among the removed TS 
packet header and the PES packet header, PTS/DTS are stored 
in association with a corresponding PES packet. 

The peripheral circuit 13a is a wire logic that realizes : 
transferring between the coded data buffer 13 and the stream 
graphics processor 14; and transferring between the coded 
data buffer 13 and the composition buffer 16. In such 
transferring processing, when it reaches a time shown by the 
DTS of an ODS , the ODS is transferred from the coded data 
buffer 13 to the stream graphics processor 14. In addition, 
when it reaches the time shown by the DTS of an ICS and a 
PDS, the ICS and the PDS are transferred to the composition 
buffer 16 . 

The stream graphics processor 14 decodes an ODS, and 
writes the decompressed graphics composed of index colors 
resulting from decoding, to the object buff er 15 , asagraphics 
object. The decoding by the stream graphics processor 14 
starts at the time of a DTS associated with the ODS, and ends 
at the time of a PTS associated with the ODS. The decode 
rate *Rd" for the aforementioned graphics object corresponds 
to an output rate of this stream graphics processor 14 . 

The graphics object obtained from the decoding of the 
stream graphics processor 14 is stored in the object buffer 
15. FIG. 28 is a diagram showing a storage content of the 
object buffer 15, in contrast to the graphics plane 8. This 
storage content assumes a case where the ODSs in the example 
shown by FIGs.16 and 17 are written to the object buffer 15. 
In the example of FIGs.16 and 17, four-button animation is 
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realized by 36 ODSs (ODS11-49) . In this example, the ODSs 
representing all the frames of this animation are stored in 
the object buffer 15. In contrast, a display position of 
each of the ODSs stored in the object buffer 15 is defined 
in the graphics plane 8. This display position is defined 
by button_Jiorizontal position and button_vertical position 
of each piece of button information. The animation is 
realized by transferring the ODSs from the object buffer 15, 
frame by frame, so as to write the ODSs to the corresponding 
display positions of the graphics plane 8. 

The composition buffer 16 is a memory in which ICS and 
PDS are disposed. 

The graphics controller 17 decodes the ICS disposed 
in the composition buffer 16, and performs control according 
to the ICS. The execution timing of this control is based 
on the value of PTS assigned to the ICS. One of the most 
important functions of this graphics controller 17 is writing 
processing at initial display and at update of an interactive 
display. The following explains writing processing of the 
graphics controller 17 at initial display and at update, by 
referring to FIG. 29. FIG. 29 is a diagram showing the 
processing performed by the graphics controller 17 at an 
initial display. As shown in this drawing, the graphics 
controller 17 performs control to write the ODSs belonging 
to the S-ODSs of the button A, to a display position defined 
by the button_horizontal_position and the 

button_vertical_position of the button A's button 
information, and to write the ODSs belonging to the N-ODSs 



of the buttons B, C, andD, respectively to display positions 
defined by the button_horizontal_position and the 
button__vertical_position of the button information of the 
buttons B, C, and D (The arrows wl , w2 , w3 , and w4 in the 
5 drawing symbolically show the above-described writing) . By 
the writing, the initial display of FIG. 20 is realized. 
Please note here that not all the ODSs are not necessary for 
an initial display of an interactive display. The initial 
display is realized when the ODSs belonging to the S-ODSs 

10 of the default selected button and the ODSs belonging to the 
N-ODSs of the other buttons have been ready on the object 
buffer 15. That is, the graphics controller 17 can start 
writing for an initial display, if decoding has been complete 
for the ODSs belonging to the S-ODSs of the default selected 

15 button, and for the ODSs belonging to the N-ODSs of the other 
buttons . 

FIG. 30 is a diagram showing processing of the graphics 
controller 17 at an update of an interactive display according 
to IstUserAction (MoveRight ) . As shown in this drawing, the 

20 graphics controller 17 performs control to write the ODSs 
belonging to the S-ODSs of the button B, to a display position 
defined by the button_horizontal_position and the 
button_vertical_position of the button B's button 
information, and to write the ODSs belonging to the N-ODSs 

25 of the button A, to a display position defined by the 
button__horizontal_j?osition and the 

button__vertical_position of the button A's button 
information (The arrows w5 , w6 , w7 , and w8 symbolically show 



the writing) . By this writing, the state transition as shown 
in FIG. 20 is realized. The buttons C and D stay in normal 
state, just as in the initial display of the interactive 
display, but the writing for these buttons to the graphics 
5 plane 8 is continued so as to continue the animation. 

FIGs . 31 and 32 respectively show the processing of the 
graphics controller 17 , in each cases where the IstUserAction 
is MoveDown and Activated . At an interactive -display update , 
S-ODSs and A-ODSs for the buttons other than the default 
10 selected button are involved, and so all the ODSs are required 
to exist in the object buffer 15. 

The UO controller 18 detects a user operation directed 
to the remote controller and to the front panel of the 
reproduction apparatus, and outputs information 
15 corresponding to the user operation (hereinafter xv UO(user 
operation)''), to the control unit 20. 

The player register group 19 is a register embedded 
in the control unit 20, and is comprised of 32 player status 
registers and 32 general purpose registers. The meaning of 
20 the set value of the player status registers (PSR) is described 
below. In the following, the notation as *PSR(x) " represents 
a set value of the xth player status register. 



PSR(0) : Reserved 

25 PSR(l) : stream no. of audio stream to be decoded 

PSR(2) : stream no. of sub-picture stream to be 

decoded 

PSR(3) : no. representing angle setting by a user 
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PSR(4) 
PSR(5) 
PSR(6) 
PSR(7) 
5 PSR(8) 

PSR( 9 ) 
PSR(IO) 
PSR(ll) 
10 PSR(13) 
PSR(14) 

PSR(15) 

15 PSR(16) 

PSR(17 ) 

PSR(18) 
20 PSR(19)- 



title no. currently reproduced 
chapter no. currently reproduced 
PL no. currently reproduced 
Playltem no. currently reproduced 
: time information indicating current 

reproduction point 

: counted value at navigation timer 

: button no. currently in selected state 

( 12 ) : Reserved 

: parental level setting by a user 

: video reproduction setting of reproduction 
apparatus 

: audio reproduction setting of 

reproduction apparatus 

: language code representing audio setting 
of reproduction apparatus 

: language code representing sub- title 
setting of reproduction apparatus 
: language setting for menu rendering 
(63) : Reserved 



The PSR(8) is updated every time each piece of picture 
data of a AV Clip is displayed. In other words, when the 
reproduction apparatus displays a new piece of picture data, 
25 the PSR( 8 ) is updated to indicate the value shown by the display 
start time (presentation time) of the new piece of picture 
data. By referring to this PSR(8), it is possible to know 
the current reproduction point. 
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The control unit 2 0 performs integration control 
through 

bi-directional communication with the graphics decoder 12. 
The communication from the control unit 20 to the graphics 
decoder 12 is to output an UO received at the UO controller 
18 to the graphics decoder 12 . The communication from the 
graphics decoder 12 to the control unit 2 0 is to output a 
button command included in an ICS to the control unit 20. 

In the reproduction apparatus constituted as above, 
each constituting element performs decoding processing using 
pipelining . 

FIG. 33 is a timing chart showing the pipelining 
performed by the reproduction apparatus . The fourth row 
represents a Display Set in a BD-ROM, and the third row 
represents reading periods that are respectively for reading 
the ICS, PDS, andODS, to the coded data buff er 13 . The second 
row represents decoding periods for ODSs, performed by the 
stream graphics processor 14. The first row represents 
processing periods by the graphics controller 17. The 
decoding start time for each ODS is shown by the DTS11 , DTS12 , 
and DTS13 in the drawing. The storing of ODS ( N-ODSs [ODS1 ] ) 
(being the first ODS among the N-ODSs ) to the coded data buffer 
13, finishes by DTS11, and the storing of ODS ( N-ODSs [ODSn] ) 
(being the last ODS among the N-ODSs) to the coded data buffer 
13, finishes by DTS12 . In this way, each ODS will have been 
read to the coded data buffer 13 by the time shown by its 
own DTS . 

On the other hand, the decode end time for each ODS 



is shown by PTS11, PTS12, PTS13 , in the drawing. Decoding 
of N-ODSs(ODSl) performed by the stream graphics processor 
14 finishes by PTS11, and decoding of N-ODSs(ODSn) finishes 
by PTS12 . In the above way, each ODS is read to the coded* 
data buffer 13 by the time shown by the DTS of the ODS, and 
the ODS read to the coded data buffer 13 is decoded and written 
to the object buffer 15 by the time shown by the PTS of the 
ODS . The stream graphics processor 14 performs the described 
series of processing using pipelining. 

When the default selected button is statically decided, 
the time at which all the graphics objects for an initial 
display of an interactive display are ready is when the 
decoding of a first ODS of the button-state set corresponding 
to the normal state and of a first ODS of the button- state 
set corresponding to the selected state is complete . In this 
diagram, at the time shown by the PTS13 , all the graphics 
objects necessary for the initial display of the interactive 
display are ready. 

In the drawing, the period cdl in the first row 
represents a period required to clear the graphics plane 8 
by the graphics controller 17. In addition, the period tdl 
is a period required to write, to the graphics plane 8 , graphics 
objects that correspond to the first page of the interactive 
display, among those obtained in the object buffer 15. The 
writing destination in the graphics plane 8 is shown by 
button_horizontal_position and button_vertical_posit ion in 
the ICS. In other words, the decompressed graphics 
constituting the interactive display is obtained to the 



graphics plane 8 , at a time calculated by adding the screen 
clearing period ^cdl" and the write time required to write 
the graphics object obtained by decoding XN tdl" , to the PTS13 
for ODS . An overlayed image can be obtained by having the 
CLUT unit 9 to perform the color conversion for the 
aforementioned decompressed graphics, and having the 
addition device 10 to perform combining the result with the 
decompressed pictures stored in the video plane 6 . 

In contrast to the case where an initial display is 
performed by decoding all the ODS included in a Display Set, 
the initial display in the present embodiment is performed 
earlier by the period hyl in the drawing, because the initial 
display is performed before decoding completion for the 
button-state set corresponding to the selected sate and the 
button-state set corresponding to the active state. 

Note that in this drawing, there are several sets of 
ODSl-ODSn . However these sets respectively belong to N-ODSs , 
S-ODSs, and A-ODSs, and so the same ODSls are different in 
content from each other. This also applies to the similar 
drawings in the present invention. 

Even while the graphics decoder 12 is performing 
clearing of, and writing to the graphics plane 8, the stream 
graphics processor 14 is continuously decoding the remaining 
ODSs (i.e. decoding period for ODSn in the second row, decoding 
period for ODS1, and decoding period for ODSn) . According 
to this, decoding of the remaining ODSs will finish early. 
This leads to early preparation for updating the interactive 
display, and so it becomes possible to respond to a user 



operation regarding an interactive display update by means 
of the remaining ODSs , without delay . The pipelining as above 
enables prompt execution of both of an initial display and 
an update of an interactive display. 
5 FIG . 33 assumes a case where the default selected button 

is statically decided, whereas FIG. 34 is a timing chart 
showing pipelining performed by the reproduction apparatus 
in a case where the default selected button dynamically 
changes. When the default selected button dynamically 

10 changes , the graphics ob j ects necessary for an initial display 
will be ready when all the ODSs belonging to the button- state 
sets respectively corresponding to the N-ODSs and the S-ODSs 
are decoded, and corresponding graphics objects are obtained 
in the graphics plane 8 . In contrast to the case where it 

15 is necessary to decode all the ODSs in a display set so as 
to perform an initial display, the initial display in the 
present embodiment is made possible before decoding 
completion of the button - state set corresponding to the active 
state . Therefore the initial display execution is performed 

20 earlier by the period hy2 in the drawing. 

Next, how to implement the control unit 2 0 and the 
graphics decoder 12 is explained . The control unit 20 creates 
a program for performing processing shown in FIGs.35 and 36, 
which is implementable by a general CPU. As follows, the 

25 processing performed by the control unit 20 is explained with 
reference to FIGs.35 and 36. 

FIG. 35 is a flowchart showing the execution procedure 
for a LinkPL function, performed by the control unit 20. In 



decoding of the commands including the LinkPL function, the 
control unit 20 follows the flowchart of this drawing. 

Here, assumption is made that a processing- target 
Playltem in the flowchart is called "Ply", and a 
5 processing-target ACCESS UNIT is called "ACCESS UNITv" . In 
this flowchart, current PL information ( .mpls) indicated by 
an argument of. the LinkPL is read (Step SI), and the first 
PI information in the current PL information is set as Ply 
(Step S2). Then the Clip information specified by the 
10 Clip_inf ormation_f ile_name of the Ply is read (Step S3). 

Once the Clip information is read, In_time of the Ply 
is converted to an address using EP_map of the current Clip 
information (Step S4). Then the ACCESS UNIT specified by 
this address is set as the ACCESS UNITv (Step S5) . Out__time 
15 of the Ply is converted to an address using EP_map of the 
current Clip information (Step S6). Then the ACCESS UNIT 
specified by this address is set as ACCESS UNITw (Step S7) . 

In this way, once the ACCESS UNITv, w are decided, an 
instruction is given to the BD drive to read from the ACCESS 
20 UNITv to the ACCES UNITw (Step S8), and an instruction for 
decoding/outputting of Ply from the In_time to the Out_time, 
is given to the video decoder 5, the audio decoder 7, and 
the graphics decoder 12 (Step S9). 

Step Sll is for performing ending judgment for the 
25 flowchart. Specifically, it is judged whether the Ply has 
reached the last PI. If the Step Sll results in Yes, the 
flowchart is ended. Otherwise, the next Playltem is set as 
Ply (Step S12), and the operation returns to Step S3. 



Hereinafter, the processing of Step Si-Step S10 is repeated 
until Step Sll results in Yes. 

Step S10 is a step for loading functional segments to 
the coded data buffer 13 , in response to the reading of ACCESS 
UNIT . 

FIG . 36 is a flowchart showing the procedure for loading 
processing for the functional segments. In this flowchart, 
xx SegmentK" represents a variable corresponding to each of 
Segment ( ICS , ODS , PDS ) read together with the ACCESS UNIT. 
An ignore flag is used to switch between ignoring and loading 
of SegmentK. This flowchart has a loop structure in which 
processing of Steps S21-S24 , and Steps S27-S35 is repeatedly 
performed for all the SegmentK, when the ignore flag has been 
set as vx 0", and has been initialized (Step S25, S26). 

Step S21 is for judging whether a SegmentK is an ICS. 
If the SegmentK is an ICS, judgments of Step S27 and Step 
S28 are performed. 

Step S27 is for judging whether the Segment_Type of 
the ICS is an Acquisition Point or not. If the SegmentK turns 
out to be an Acquisition Point, the operation moves onto Step 
S2 8. Conversely, if the SegmentK turns out to be either an 
Epoch Start or a Normal Case, the operation moves onto Step 
S33 . 

Step S28 is for judging in which buffer ( among the coded 
data buffer 13, the stream graphics processor 14, the object 
buffer 15, and the composition buffer 16) , the preceding DS 
is found within the graphics decoder 12, and is performed 
when Step S27 has resulted in Yes. When a DS is not found 



in the graphics decoder 12, it means that a random access 
has been performed. In this case, display should start from 
the DS being an Acquisition Point. Therefore the operation 
moves onto Step S30 (Step S28:No). 

When the preceding DS is found in the graphics decoder 
12 (Step S2 8 : Yes) , the ignore flag is set as "1" (Step S2 9) , 
and the operation moves onto Step S31. 

Step S31 is for j udging whether the cominand__update_f lag 
is set as 1 or not. If 1 (Step S31:Yes), only the button 
command in the button information is loaded to the coded data 
buffer 13, and the others are ignored (Step S32) . If 0, the 
operation moves onto Step S22. In this way, ICSs indicating 
an Acquisition Point, will be ignored (Step S24) . 

If the ignore flag is set as 1, Step S22 will result 
in No, and as a result, all the functional segments belonging 
to an Acquisition-point DS are ignored. 

Step S3 3 is for judging whether the Segment_Type in 
an ICS indicates a Normal Case or not. When the SegmentK 
is an Epoch Start, the ignore flag is set as 0 at Step S30. 

When the ignore flag is 0 (Step S22:Yes) , the SegmentK 
is loaded to the coded data buffer 13 (Step S23). 

When the SegmentK is a Normal Case, the operation moves 
onto Step S34. Step S34 is the same as Step S28, in content, 
and is for judging whether the preceding DS is found in the 
graphics decoder 12. If the judgment is in the affirmative, 
the ignore flag is set as xx 0" (Step S30) . If the judgment 
is in the negative, the ignore flag is set as "1", because 
it is inherently impossible to obtain sufficient number of 



functional segments for constituting an interactive display 
(Step S35) . According to the above flag setting, when the 
preceding DS cannot be found in the graphics decoder 12, the 
functional segments constituting the Normal Case will be 
5 ignored. 

Next, the following explains how reading of a DS is 
performed in a case where multiplexing involving DS is 
performed as in FIG. 37. In the example of FIG. 37, three DSs 
have been multiplexed with amotion picture made of a plurality 

10 of pictures. In the first DS (DS1) among the three DSs, 
Segment_Type indicates an Epoch_Start, Command_update_f lag 
is set as 0, and a button command of LinkPL ( PL#5 ) is included. 

DS10 is a duplicate of DS1, and DSlO's Segment_Type 
indicates an Acquisition Point, and Command_update_f lag is 

15 set as 0, and a button command of LinkPL ( PL#5 ) is included 
therein . 

DS20 is an Inherit of DS1, and DS20's Segment_Type 
indicates an Acquisition Point. The only difference with 
DS1 is the button command ( LinkPL (PL# 10 ) ) . So as to indicate 

20 existence of a difference, Command_update_f lag is set as 1. 

In an AV Clip in which the above-described three DSs 
have been multiplexed with a motion picture, suppose that 
random access is performed at the picture data ptlO . In this 
case, the nearest DS10 to this random-access point will be 

25 a target of the flowchart processing of FIG . 36 . At Step S27 , 
segment_type is judged to be an Acquisition Point, but the 
preceding DS cannot be found in the graphics decoder 12 . 
Therefore the ignore flag is set as 0, and this DS10 is loaded 



to the coded data buffer 13 in the reproduction apparatus, 
as shown in FIG . 3 8 . On the other hand, when the random- access 
point exists after the point where the present Display Set 
10 exists (the broken line hstl in FIG. 37), the Display Set 
20 (hst2 in FIG. 38) that follows the Display Set 10 is read 
to the coded data buffer 13. 

FIG. 40 shows how the loading of DS1, DS10, and DS20 
is performed when a normal reproduction is performed as in 
FIG. 39. Among the three DSs, DS1 whose segment_type in ICS 
is an Epoch Start is loaded to the coded data buffer 13, as 
it is (Step S23). However, DS10 whose segment__type in ICS 
is an Acquisition Point, has the ignore flag set as 1 (Step 
S29), and so the functional segments constituting DS10 are 
ignored and not loaded to the coded data buffer 13 (Step S24 ) . 
With regard to DS20, Segment_type of ICS indicates an 
Acquisition Point, but command_update_f lag is set as 1. 
Therefore, Step S31 results in Yes, and so only the button 
command is loaded. As a result, as for the DS of the coded 
data buffer 13 , only the button command in the ICS is replaced 
with this loaded button command (Step S32) . Here, since the 
ignore flag still indicates 1, other elements than the button 
command are ignored and not loaded. 

Although having the same display content as the DS1, 
the button command has been replaced from the LinkPL(#5) of 
the DS1 to the LinkPL ( #10 ) of DS20, on arriving at the DS20. 
Such replacement facilitates control to change the content 
of the button command in course of the reproduction. Next, 
the processing procedure of the graphics controller 17 is 



described. FIG. 41 is a flowchart in which processing 
corresponding to the main routine in the processing of the 
graphics controller 17 is described. In this flowchart, the 
three kinds of processing are repeatedly performed : time stamp 
synchronized processing (Step S35); animation display 
processing (Step S36); and UO processing (Step S37). 

FIG . 42 is a flowchart showing the processing procedure 
for synchronized control performed by means of a time stamp. 
In this flowchart, it is judged whether any of the phenomena 
of Step S41, S43-Step S47 holds. If any of the phenomena 
holds, a subroutine is formed in which a corresponding 
operation is performed, and then the operation returns to 
the main routine. 

Step S41 is for j udging whether the current reproduction 
time is any one of a time shown by the PTS of the S-ODSsf irst, 
and a time shown by the PTS of the S-ODSslast . If the judgment 
is in the affirmative, a period a is calculated at Step S42 . 
The period a is a period obtained by adding ( 2 ) a time required 
to clear a graphics plane, and (3) a time required to write 
a graphics object obtained by decoding an ODS to the graphics 
plane . 

At Step S42, the graphics controller 17 refers to 
Segment_Type of ICS, and if the Segment_Type indicates an 
Epoch Start, a is set as (2) plane clearing time + (3) plane 
writing time. If it indicates an Acquisition Point, a is 
set as ( 3 ) plane writing time . To calculate the plane writing 
time (3), the calculation of Fig.23A is used when the 
default_selected_button_number indicates a valid value . On 
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the other hand, when the def ault_selected_button_n umber 
indicates 0, the calculation of FIG.23B is used to calculate 
the plane writing time ( 3 ) . After the period a is calculated 
in the above way, the operation returns to loop processing. 

Step S43 is for j udging whether the current reproduction 
time is a time indicated by the PTS-a of ICS . If the judgment 
is in the affirmative, writing processing to the graphics 
plane 8 is performed (Step S51), and the operation returns 
to the main routine. 

Step S45 is for j udging whether the current reproduction 
time is PTS of ICS. If the judgment is in the affirmative, 
outputting the storage content of the graphics plane 8 is 
started. The outputting destination of this storage content 
is the CLUT unit 9. After being subjected to the color 
conversion at the CLUT unit 9, the interactive display will 
be overlayed with the storage content of the video plane 6 . 
By doing so, an initial display is performed ( Step S52 ) . Then 
the variable M animation(p) (p=l, 2, 3, ...n) is set as 0 (Step 
S53) , and the operation returns to the main routine. Here, 
the variable xx animation ( p ) " is a global variable indicating 
the ordinal position of the current frame in the sequence 
of frames, which will stay valid throughout a plurality of 
flowcharts. At Step S53, the button (p) of all the buttons 
will be set as 0 . 

Step S4 6 and Step S4 7 are for j udging whether the current 
reproduction time has reached the time information described 
in ICS. 

Step S4 6 is for j udging whether the current reproduction 



time is a time shown by selection_TimeOut_PTS . If the 
judgment is in the affirmative, processing to activate a 
button indicated by the def ault_activated__button_number is 
performed, and the operation returns to the main routine (Step 
S54) . 

Step S47 is for j udging whether the current reproduction 
time is a Compos ition_TimeOut_PTS . If the judgment is in 
the affirmative, screen clearing is performed and the 
operation returns to the main routine (Step S55). In the 
above-described synchronized processing by means of a time 
stamp, Step S51 and for Step S54 are respectively created 
as a subroutine. As follows, the processing performed at 
the subroutine of Step S51 is explained with reference to 
FIG. 43 . 

FIG. 43 is a flowchart showing a processing procedure 
for writing an initial display of a menu to the graphics plane 
8. Step S64 is for judging whether Segment_type of ICS 
indicates an Epoch Start. If the judgment is in the 
affirmative, the graphics plane 8 is cleared at Step S65, 
and the processing of Step S66-Step S73 is performed. The 
time required to clear the graphics plane 8 corresponds to 
a period cdl in FIG. 25 and in FIG. 26. If the judgment is 
in the negative, Step S65 is skipped and the processing of 
Step S66-Step S73 is performed. 

Step S66 -Step S73 form loop processing that is repeated 
for each piece of button information in an ICS (Step S66, 
Step S67). In this loop processing, a piece of button 
information that is the processing target is called "button 
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information ( p ) " . 

Step S67 is for judging whether 

def ault__selected_button__number indicates a valid number. 
Step S6 8 is for judging whether button_inf o (p ) corresponds 
to the default selected button specified by the 
default_selected_button_number . 

If thebutton_inf o(p) does not correspond to the def ault 
selected button, the graphics object of the 
start_object__id_normal indicated by the normal_state__inf o 
of the button_info(p) is found from the object buffer 15, 
and set as a graphics object(p) (Step S69). 

If the button_inf o(p) does correspond to the default 
selected button, the graphics object of the 
start_ob j ect_id_selected is found from the object buffer 15 
(Step S70) , and the button (p) is set as a current button (Step 
S71) . The current button is a button set in selected state 
in the interactive display currently displayed, and the 
reproduction apparatus stores the identifier of this current 
button as PSR(IO). 

After being identified by going through Step S69 - Step 
S70, the graphics object (p) is written to a graphics plane 
8, at a position shown by the button_Jiorizontal_position and 
button_vertical_position of the button_inf o ( p ) (Step S72) . 
By repeating this processing to each piece of button 
information of an ICS, the first graphics object will be 
written to the graphics plane 8 . The time required to complete 
this processing for the graphics objects, which are among 
those on the graphics plane 15 and are necessary for an initial 



display, corresponds to the time tdl shown in FIG. 2 5 and 
FIG. 26 . 

When the default_selected_button_number indicates 0, 
and the default selected button dynamically changes, Step 
S67 will be No, and at Step S73, it is judged whether the 
button_inf o ( p ) corresponds to the current button. If the 
judgment is in the affirmative, the operation moves onto Step 
S7 0 . If the judgment is in the negative, the operation moves 
onto Step S6 9. 

Next, a processing procedure for a subroutine of Step 
S54 is explained with reference to FIG. 44. 

FIG. 44 is a flowchart showing a processing procedure 
how to auto-activate a default selected button. First, 
whether the def ault_activated_button_number is 00 or FF, is 
judged (Step S75) . If the def ault_activated_button_number 
is xx 00", the operation returns to the main routine without 
performing any processing. If the 

def ault_activated_button_number is "FF" , the current button 
i is changed to active state ( Step S77 ) . Then animation ( i ) , 
which is a variable corresponding to the current button i, 
is set as 0, and the operation returns to the main routine 
(Step S78) . 

If the def ault_activated__button_number is neither 00 
or FF, the button indicated by the 

def ault_activated_button_number is set as a current button 
(Step S76), and the current button i is changed to active 
state (Step S77) , and the animation (i) , which is a variable 
correpsonding to the current button i, is set as 0, and the 



operation returns to the main routine (Stpe S78). 

According to the above processing, after a 
predetermined time, the button in selected state will be 
changed to active state. 

Next, the animation in a menu (Step S3 6) is described. 
FIG. 45 is a flowchart showing a processing procedure for an 
animation display. 

Here, the initial display is realized by writing 
graphics objects specified by start__ob j ect_id_normal of 
normal__state_inf o, and start__ob j ect__id_selected of 
selected_state_inf o, in each button_info, to the graphics 
plane 8. The animation is processing to overwrite this 
graphics plane 8 with an arbitrary frame (i.e. a graphics 
object corresponding to a gth frame) in each button, every 
time the loop operation of Step S35-Step S37 finishes one 
loop. Specifically, this process of updating is realized 
by writing graphics objects specified by normal_state_inf o 
and selected_state_info, in button_info, one by one to the 
graphics plane 8 and returning to the main routine. Here, 
"q" is a variable for specifying each graphics objects 
specified by normal_state_info and selected_state_inf o of 
button_info of each piece of button information. 

The processing for realizing this animation display 
is explained with reference to FIG. 45. For brevity, this 
flowchart is created based on the assumption that 
repeat_normal_f lag and repeat_selected_f lag are set to 
indicate that the repetition is necessary. 

Step S80 is for judging whether an initial display has 



been complete. If an initial display has not been complete, 
the operation makes a return, without performing any 
processing. If an initial display has been complete, Step 
S81-Step S93 is designed to structure loop processing in which 
the processing of steps S81-Step S93 is repeated for each 
button_info in an ICS (Step S81, Step S82). 

Step S83 sets animation (p) ( the variable corresponding 
to the button_inf o(p) ) , to a variable g. In this way, the 
variable gwill indicate the ordinal position of the current 
frame in the sequence of frames, which corresponds to the 
button_inf o (p ) . 

Step S84 is for judging whether button_inf o ( p ) 
corresponds to a button currently in selected state (current 
button) . 

If the button_inf o (p ) corresponds to a different button 
from the current button, an identifier, obtained by adding 
the variable q to start_ob j ect__id_normal of 
normal__state_inf o of button_inf o ( p ) , is set as ID(q) (Step 
S85) . 

I f the button_inf o ( p ) corresponds to the current button , 
the judgment of Step S8 6 is performed. 

Step S86 is for judging whether the current button is 
in active state. If the judgment is in the affirmative, an 
identifier, obtained by adding the variable q to 
start_object_id_actioned of actioned_state_info of 
button_inf o(p) , is set as ID(q) (Step S87) . Then one of the 
button commands that are included in button_inf o(p) is 
executed (Step S88). 



If the current button is judged not to be in active 
state, an identifier, obtained by adding the variable g to 
start_ob j ect__id_selected of selected_state_info of 
button_info(p) , is set as ID(q) (Step S89). 

In this way, once ID(q) is decided, the graphics object 
(p) that has the ID(q) and exists in the object buffer 15 
is written to the graphics plane 8 , at a position indicated 
by button_horizontal_position and button_vertical_pos it ion 
of button_info(p) (Step S90). 

According to the above loop processing, qth frame of 
the plurality of graphics objects, which respectively 
constitute the selected state ( or active state ) of the current 
button and the normal state of the other buttons, will be 
written to the graphics plane 8 . 

Step S91 is for judging whether 

start_ob j ect_id_normal+q has reached end_ob j ect_id_normal . 
If the judgment is in the negative, the variable 
"animation (p ) " is incremented by the variable g (Step S92) . 
If the judgment is in the affirmative, the variable 
"animation ( p ) " is initialized to have a value "0" ( Step S93 ) . 
The above-described processing is repeated to all the 
button_info in the ICS ( Step S81 , Step S82 ) . After completion 
of the processing for all the button_info in the ICS, the 
operation returns to the main routine. 

By performing Step S80 - Step S93, the design image 
for each button in the interactive display will be updated 
to a new graphics object every time one loop of Step S3 5 -Step 
S3 7 is finished . If the loop of Step S3 5 -Step S3 7 is performed 



many times, a so-called animation is realized. In the 
animation, the graphics controller 17 performs time 
adjustment so that the display interval for one frame of 
graphics object is set as a value indicated by 
animation_frame_rate_code . 

In the above explanation, the button commands in 
button_inf o(p) are executed one by one. However, it is also 
possible to execute all the button commands included in 
button_inf o (p ) at a time, after all the graphics objects 
corresponding to the active state have been displayed . Next , 
the processing procedure for UO processing at Step S37 in 
the main routine is explained with reference to FIG. 46. 

FIG . 46 is a flowchart showing the processing procedure 
of the UO processing. In this flowchart processing, it is 
judged whether any of the phenomena of Step SlOO-Step S103 
holds, and if it does, corresponding processing is executed, 
and the operation returns to the main routine. Step S100 
is for judging whether UomaskTable is set as 1 . If the 
judgment is in the affirmative, the operation returns to the 
main routine without performing any processing. 

Step S101 is for judging whether any of 
MoveUP/Down/Lef t/Right keys has been pushed. If the 
judgment is in the affirmative, the current button is changed 
(Step S104), and it is judged whether auto_action_flag for 
the current button is 01 (Step S108). If the judgment is 
in the negative, the operation returns to the main routine. 
If the judgment is in the affirmative, the operation moves 
onto Step S105. 



Step S102 is for judging whether the activated key has 
been pushed. If the judgment is in the affirmative, the 
current button i is changed to active state ( Step S105 ) . Then , 
the variable "animation ( i ) " is set as 0 (Step S106). 

Step S103 is for j udging whether it is a case of numerical 
value inputting. If the judgment is in the affirmative, 
numerical -value inputting processing is performed (Step 
S107) , and the operation returns to the main routine. Among 
the processing procedures in FIG . 46 , Step S104 and Step S107 
respectively have a structure as a subroutine. The concrete 
processing procedures for the subroutines are shown in FIG . 47 
and FIG. 48. As follows, these flowcharts are explained. 

FIG .47 is a flowchart showing the procedure of changing 
processing for a current button. First, in neighbor_inf o 
of the current button, one of upper_button__number , 
lower_button_n umber , lef t__button_n umber , and 

r ight_button_n umber , which corresponds to the pressed key, 
is identified (Step S110). 

Then, the current button is set as "button i" , and the 
new current button is set as "button j " (Step Sill). Step 
S112 is for judging whether the button j set at Step Sill 
is identical to the button i. If they are identical, the 
operation returns to the main routine, without performing 
any processing. If they are not identical to each other, 
the button j is set as a current button (Step S113) , and the 
variables "animation (i)" and "animation ( j ) " are set as 0. 
Then the operation returns to the main routine (Step S114) . 

FIG . 48 is a flowchart showing the procedure of numerical 



inputting processing. It is judged whether button info. j 
having the button_number that corresponds to the inputted 
numerical value exists (Step S121) , and whether 
numerically__selectable__f lag of button info, j is 1 is judged 
5 (Step S122) . If Step S121 and Step S122 result in Yes, the 
current button is changed to normal state, and the button 
j is set as a current button (Step S123), and the variable 
"animation ( i) " and the variable "animation ( j ) " are set as 
0 (Step S124) . ■ Then it is judged whether auto_action_f lag 
10 of Button info . j is 1 ( Step S125 ) . If it is not 1 , the operation 
returns to the main routine. 

If it is 1, the current button is changed to active 
state at Step S126, and then the operation returns to the 
main routine. 

15 If one of Steps S121-S123 is No, the operation returns 

to the main routine. 

When trying to perform interactive-display display 
using a user operation as a trigger (e.g. popup display), 
the stream graphics processor 14 and the graphics controller 

20 17 perform the following processing, which is the same as 
the processing performed for synchronized display. 
According to this, the graphics object is obtained at the 
graphics plane 8 . After obtaining of graphics object in this 
way, it is waited until the current reproduction time reaches 

25 the time shown by the PTS assigned to the ICS. Then after 
this reproduction time, once a UO indicating a menu call is 
received at the UO controller 18, the graphics object is 
outputted from the graphics plane 8 to the CLUT unit 9 for 



combining . By performing suchoutputting in synchronization 
with the UO, a popup display according to the pressing of 
the menu call is realized. 

So far, how to set PTS in ICS; and DTS and PTS in ODS, 
where the ICS and ODS belong to a DSn , was explained . However , 
DTS in ICS; DTS, PTS in PDS; and DTS, PTS in END have not 
been explained yet . As below, these times tamps are explained 
The ICS should be loaded to the Composition buffer 16 , before : 
a decode start time of the first ODS(ODSl) in the DSn (i.e. 
DTS(DSn[ODSl] ) ) ; and before the first PDS(PDSl) in the DSn 
becomes valid (i.e. PTS (DSn [ PDS1 ] ) ) . Specifically, the 
following relations should be satisfied. 

DTS(DSn[ICS] ) <DTS ( DSn [ODSl ] ) 

DTS(DSn[ICS] ) <PTS (DSn [PDS1] ) 

As follows, setting of DTS, PTS in each PDS belonging 
to the DSn is described. 

Each PDS belonging to the DSn should be valid in the 
CLUT unit 9, between a time at which the ICS is loaded to 
the composition buffer 16 (DTS (DSn [ ICS] ) ) and a decode start 
time of the first ODS (DTS (DSn [ODSl] ) ) . Therefore for each 
of PTS values for PDS ( PDS1 - PDS last ) , the following relations 
should be satisfied. 

DTS(DSn[ICS] ) <PTS ( DSn [ PDS1 ] ) 

PTS (DSn [ PDS j] ) <PTS ( DSn [ PDS j +1 ] ) <PTS ( DSn [ PDSlast ] ) 
PTS(DSn[PDSlast] ) <DTS ( DSn [ODSl ] ) 

Note that even though not being referred to at 



reproduction, a DTS of a PDS will be set at the same value 
as a corresponding PTS , so as to comply with the MPEG2 standard. 

The following explains the meaning of DTS and PDS in 
the pipeline of a reproduction apparatus, once the DTS and 
the PDS are set so as to satisfy the above relations . FIG . 49 
is a diagram showing a pipeline in a reproduction apparatus, 
based on the DTS in the ICS, and the PTS in the PDS. FIG. 49 
is created based on FIG. 33. "Reading to coded data buffer 
13" found in the third row of FIG. 33 corresponds to the fifth 
row in the present drawing . In addition , "decoding by Stream 
Graphics processor 14" found in the second row corresponds 
to the fourth row in the present drawing. Moreover, the ICS 
and the PTS are set so as to satisfy the above-presented 
relations . 

The second row in FIG. 49 is a PDS setting to the CLUT 
unit 9 . The third row shows a storage content of the 
composition buffer 16 . The DTS in the ICS is set at an earlier 
time than the DTS of the PDS or the DTS of the ODS . Therefore, 
as the arrow upl shows in this drawing, loading of the ICS 
to the composition buffer 16 is performed first of all. In 
addition, setting of PDSl-last to the CLUT unit 9 is performed 
after transfer of the ICS and before decoding of the 0DS1, 
and so is set before the DTS of the ODS1, as the arrow up2 
and up3 show in the drawing. 

As clear from the above, loading of ICS, and setting 
of PDS are done prior to decoding of ODS . 

Next, setting of PTS for "END of Display Set Segment" 
belonging to the DSn is described . The End of the DSn indicates 
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ending of the DSn, and so is to indicate a decode end time 
of the last ODS(ODSlast) of the DSn. This decode end time 
is indicated by the PTS of the ODSlast ( PTS (DSn [ODSlast ] ) ) . 
Therefore the PTS in the END should satisfy the following 
5 relation. 

PTS ( DSn [ END ] ) =PTS ( DSn [ ODSlast ] ) 

In relation to the ICSs belonging to DSn and DSn+1, 
the ICS in the DSn is loaded to the composition buffer 16 
prior to the loading time of the first ODS(ODSl) , and so the 
PTS of the END should be after a loading time of ICS belonging 
to the DSn ( DTS ( DSn [ ICS ] ) ) , and before a loading time of ICS 
belonging to the DSn+1 ( DTS ( DSn+1 [ ICS ] ) ) . 

DTS (DSn [ICS] ) <PTS (DSn [END] ) <DTS ( DSn+1 [ ICS ] ) 

On the other hand, a loading time for the first ODS (ODS1 ) 
is after a loading time of the last PDS(PDSlast) . And so 
PTS of END ( PTS (DSn [END] ) ) should be after a loading time 
of PDS belonging to the DSn belonging to the DSn 
(PTS (DSn [PDSlast] ) ) . Therefore PTS of END should satisfy 
the following relation. 

PTS (DSn [PDSlast] ) <PTS ( DSn [END] ) 

Next, the meaning of PTS of END in the pipeline of the 
25 reproduction apparatus is explained. FIG. 50 is a diagram 
showing the meaning of the END during operation of the pipeline 
of the reproduction apparatus . This diagram is created based 
on FIG. 33, and almost all the rows therein are the same as 
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those of FIG. 33, except that the first row indicates the 
storage content of the composition buffer 16. In addition, 
FIG. 50 renders two display sets, namely DSn and DSn+1. In 
the DSn, the ODSlast is the last ODSn of A-ODSs, and so the 
5 PTS of the END is set to indicate the PTS of this ODSn. The 
time shown by the PTS of this END is earlier than the time 
shown by the DTS of the ICS in DSn+1 . 

According to the PTS of this END, in reproduction, it 
becomes possible to know which time ODS loading with respect 
10 to DSn completes . 

Note that even though not being referred to at 
reproduction, a DTS of an END will be set at the same value 
as a corresponding PTS , so as to comply with the MEPG2 standard . 

In the above structure, ICS, PDS , and ODS, in which 
15 DTS and PTS are set , are incorporated into an AVClip in advance . 
This is convenient for describing interactive control for 
having a reproduction apparatus to execute certain processing 
at which a frame of the motion picture appears on a screen, 
such interactive control being closely synchronized with the 
20 content of a motion picture. In addition, in the above 
structure, ICS, PDS, and ODS are multiplexed to the AV Clip 
itself. Therefore even when the number of sections to be 
a reproduction control target is some hundreds, it is not 
necessary to store all the corresponding ICS, PDS, and ODS. 
25 ICS, PDS, and ODS are read from a BD-ROM together with video 
packets. The procedure to be followed is to read ICS, PDS, 
and ODS for a motion picture section that is to be reproduced 
at the moment onto the memory, and after completion of the 



-reproduction of this motion picture section, delete the ICS, 
PDS, and ODS from the memory, and then store a new set of 
ICS, PDS, and ODS corresponding to the next motion picture 
section, to the memory. According to the above structure, 
5 the occupied area of a memory is limited to minimum even when 
the number of ICS, PDS, and ODS becomes some hundreds. 

As described so far , according to the present embodiment , 
there are 360 pages of ODSs for rendering animation. Under 
an assumption that there are three button-state sets, the 

10 ODSs will be grouped under three button-state sets (e.g. 
120 + 120 + 120 pages ) . Each button-state set is placed so that 
the set that appears earlier in the animation will be placed 
nearer to the top, and the set that appears later will be 
placed farther to the top. Accordingly, in reproduction, 

15 the earlier appearing button- state set will be loaded to the 
reproduction apparatus early, postponing loading of later 
appearing button-state sets. By doing so, when once 
reading/decoding of about 1/3-2/3 of the entire ODSs are 
complete, the preparation for an initial display is ready, 

20 even though not all of the 36 0 pages of ODSs have not been 
finished being decoded. This further means that in a case 
when there is an enormous amount of ODSs to be read/decoded, 
execution of initial display will not be delayed . According 
to this, the interactive display with animation can be 

25 performed without delay. 

( Second embodiment ) 

The present embodiment relates to a production method 
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of a BD-ROM. FIG. 51 is a flowchart showing the production 
method of the BD-ROM that relates to the second embodiment. 

The production method of the BD-ROM includes : a material 
production process S201 in which material creation such as 
motion picture photographing and audio recording is 
performed; an authoring process S202 in which an application 
format is generated using an authoring apparatus; and a press 
process S203 in which a master for the BD-ROM is created by 
pressing and laminating, so as to complete the BD-ROM. 

Among these processes, the authoring process directed 
to a BD-ROM includes the following steps , Step S204-Step S209 . 

First, atStepS204, animation for frames corresponding 
to button states are created, frame by frame, in a plurality 
of pieces of graphics data in a plurality of run-length 
encoding method. 

At Step S205, the created pieces of graphics data are 
grouped under button states. Then an ICS is created in which 
each button information specifies an identifier of a piece 
of graphics data. In creation, at Step S206, setting of 
default selected button and how to vary the states of buttons , 
are written to the ICS . At Step S207 , the ICS and the grouped 
graphics data are integrated into a graphics stream. Once 
the graphics stream is generated, at Step S208, the graphics 
stream is multiplexed with a video stream and an audio stream 
created independently of the graphics stream, to obtain an 
AVClip. Once the AV Clip is obtained, at Step S209, astatic 
scenario, an active scenario, and the AV Clip are made to 
comply with the BD-ROM format, thereby completing an 
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* application format. 

As explained so far, according to the present embodiment, 
such a graphics stream as explained in the first embodiment 
is generated by performing grouping of graphics data during 
5 the authoring process. This is an easy way to generate an 
application format for a BD-ROM described in the first 
embodiment . 

( Third embodiment ) 

10 The interactive graphics stream of the first embodiment 

is recorded onto a BD-ROM by being overlayed onto an AVClip. 
However, in the third embodiment, the interactive graphics 
stream is recorded to a BD-ROM as a sub Clip separate from 
the AVClip, and the playlist information is used to associate 

15 the AVClip and the sub Clip. 

In the playlist information, the reproduction path 
formed by Play Item information is called ^main path" . In 
contrast, information indicating the sub Clip is called 
sub-path information and defines a reproduction path called 

2 0 "sub path" . 

FIG. 52 is a diagram showing an internal structure of 
PL information relating to the third embodiment. 

The arrow hcl in FIG . 52 focuses on each piece of sub-path 
information. As this arrow hcl shows, a piece of sub-path 

25 information is made of one or more sub Playltems . As the 
arrow hc2 in the drawing shows, each sub Playltem is made 
of "Clip__inf ormation_f ile_name" , "Clip_codec_identif ier " , 
"Sub Play Item_In_Time" , "Sub Play Item_Out_time" , 



VN Sync_Play Item_id" , and xv Sync_start_PTS_of Playltem". 

^Clip_inf ormation^f ile_name ff is a description of a 
file name of Clip information, which uniquely identifies a 
sub Clip corresponding to the sub Playltem. 
5 xx Clip_codec__identif ier" indicates in which coding 

method the AVClip has been encoded. 

vx SubPlayItem_In_time" indicates a start point of the 
sub Playltem on a reproduction time axis of the sub Clip. 

vx SubPlayItem_Out_time" indicates an end point of the 
10 sub Playltem on the reproduction time axis of the sub Clip. 

' x Sync_PlayItem_id" uniquely identifies one of 
Playltems constituting themain stream, with which the present 
sub Playltem is to be synchronized. xv SubPlayItem_In_time" 
exists on the reproduction time axis of the Playltem 
15 identified by this Sync_PlayItem_id" . 

' v Sync_start_PTS_of_PlayItem" indicates where on the 
reproduction time axis of the Playltem identified by the 
Sync_PlayItem_id, the start point of the sub Playltem 
identified by the SubPlayItem_In_time exists. During 
20 reproduction of the Playltem, the sub Playltem will start 
being reproduced when the current reproduction time has 
reached this Sync_start_PTS_of_PlayItem . 

FIG. 53 is a diagram schematically showing the 
synchronization of sub Playltem according to 
25 sync_PlayItem_id and sync_start_PTS_of _PlayItem . The main 
path in this drawing is made of Playltems #1, #2, and #3. 
Sync_J?layItem_id and sync_start_PTS_of_PlayItem for the sub 
Playltem constituting the sub path are as shown within the 



frame drawn in a broken line of vv whl" . Specifically, the 
sync_PlayItem__id is set to indicate the Playltem#l, and the 
sync_start_PTS_of__PlayItem is set to indicate the time tl 
on the reproduction time axis for the Play Item. In this 
5 way, when the current reproduction time has reached tl on 
the reproduction time axis of the Play Item, a part of the 
sub Clip (interactive graphics stream) identified by the 
Clip_inf ormation_f ile_name will be reproduced, the part 
specifically corresponding to a part from the 

10 SubPlayItem_In_time to Sub_PlayItem_Out_time . By 
performing reproduction in the above way , only a corresponding 
part from SubPlayItem_In_time to SubPlayItem_Out_time 
within the interactive graphics stream will be synchronously 
reproduced with the AVClip. 

15 In addition, an interactive graphics stream, being a 

sub Clip , may be recorded in an HD included in the reproduction 
apparatus. In this case, if playlist information on the HD 
corresponds the AVClip on the BD-ROM and the sub Clip on the 
HD, then the AVClip and the sub Clip can be reproduced 

20 synchronously. FIG. 54 is a diagram showing file 

identification by way of "Clip_inf ormation_f ile_name" in the 
playlist information on the HD . The arrows rfl, rf2 rf3 show 
indications by Clip_information_f ile_name of Play Items in 
the playlist information. The arrows pfl, pf2, pf3 show 

25 indications by Clip_inf ormation__f ile_name of sub Play Items 
in the playlist information. According to such indications 
by Clip_Inf ormation__f ile_name , the sub path defined for the 
sub Clip on the HD is synchronously reproduced with the main 



path defined for the main Clip on the BD-ROM. 

The following describes processing performed by the 
control unit 20, in the case where the sub Playltem to be 
synchronized with the current Playltem exists in the playlist 
information. The control unit 20 controls the sub Clip 
indicated by the sub Playltem to be reproduced synchronously 
with the main Clip. This synchronous reproduction is 
performed as follows . The picture data corresponding to the 
Sync_Start_PTS_of_PlayItem of the sub Playltem is read from 
the main Clip. Then, the data existing between the 
SubPlayItem_In_time to the SubPlayItem_Out_time of the sub 
Playltem is reproduced. 

(Note) 

15 The description so far does not show all the embodiments 

of the present invention. Needless to say, the present 
invention is also executable by various modifications, 
including the following (A), (B) , (C) , ( D ) , etc. Each 
invention relating to the claims of the present invention 

20 is either extended or generalized description of either the 
above-described embodiments or their modification examples . 
The degree of extension and generalization is based on the 
level of the state of art in this technological field, at 
the time of filing of the present invention. Please note 

25 that each invention in the claims reflects the means to solve 
the technological problems of the conventional technology, 
and therefore the scope thereof will not exceed the scope 
recognizable by a person in this technological field. 
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Therefore each invention in the claims of the present 
invention is substantially associated with the description 
of the present invention. 



5 (A) All the embodiments have assumed that the recording 
medium according to the present invention is a BD-ROM. 
However, the recording medium of the present invention is 
characterized by its graphics stream recorded therein, and 
this characteristic will not depend on the physical nature 

10 of the BD-ROM . Therefore the present invention is applicable 
to any recording medium as long as it can record an active 
scenario and a graphics stream. For example, the recording 
medium may be an optical disc such as a DVD-ROM, a DVD-RAM, 
a DVD-RW, a DVD-R, a DVD+RW, a DVD+R, a CD-R, a CD-RW. The 

15 recording medium may also be an optical magnetic disc such 
as a PD and an MO. The recording medium may further be a 
semiconductor memory card such as a compact flash card, smart 
media, a memory stick, a multimedia card, a PCM-CIA card. 
Furthermore, the recording medium may be (i) a magnetic 

20 recording disc such as a flexible disc, a SuperDisk, a Zip, 
and a Clikl, and (ii) a removable hard disc drive such as 
an ORB, Jaz, a SparQ, a SyJet, an EZFley, and a micro drive. 
Still further, the recording medium may be a hard disc being 
a constituting element of an apparatus. 

25 

(B) In all the embodiments, the reproduction apparatus 
first decodes an AV Clip recorded on a BD-ROM, before 
outputting it to a television. However, the reproduction 
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apparatus may be designed as a BD-ROM drive, with the other 
elements provided for the television. In this case, the 
reproduction apparatus and the television can be incorporated 
into a home network connected through an IEEE1394. In 
5 addition, the reproduction apparatus according to the 
embodiments is a type which is used by being connected to 
a television. However, the reproduction apparatus may be 
an integral -type with a display. Furthermore, only the 
substantial part of the reproduction apparatus of each of 

10 the embodiments may be considered the reproduction apparatus 
of the present invention. Because all such reproduction 
apparatuses are described in the present invention's 
description, act of producing any of these reproduction 
apparatuses based on the internal structure of the 

15 reproduction apparatus of the first embodiment constitutes 
an act of practicing the present invention as described in 
the description. Any act of transfer whether with charge 
or not (sales if with charge, and gifts if not with charge) , 
rent, and import relating to the reproduction apparatus of 

20 the first embodiment also constitute an embodiment of the 
present invention. In addition, any act of offering these 
transfer and rent, through storefront display, catalogue 
solicitation, and pamphlet distribution, also constitutes 
an act of practicing the present reproduction apparatus . 

25 

(C) The information processing according to the program 
shown in each of the flowcharts is executed using hardware 
resources. Accordingly, each program whose processing 
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procedure is described byway of the flowcharts is an invention 
by itself. The above embodiments describe the cases where 
the programs are incorporated in the reproduction apparatus, 
but the programs can be used independently of the reproduction 
5 apparatus. Acts of executing the programs include (1) an 
act of producing, (2) an act of transferring with or without 
charge, (3) an act of renting, (4) an act of importing, (5) 
an act of providing for the public via a bi-directional 
electronic communications network, and ( 6 ) an act of offering 
10 for transfer or rent using storefront displays, catalogs, 
or pamphlets . 

(D) Information processing using the programs shown in the 
flowcharts is actually realized using hardware resources. 

15 Accordingly, the programs which describe the operational 
procedures shown in the flowcharts are themselves an invention . 
The above embodiments describe the cases where the programs 
are incorporated in the reproduction apparatus , but the 
programs can be used independently of the reproduction 

20 apparatus. Acts of practicing the programs include (1) an 
act of manufacturing, ( 2 ) an act of transfer with or without 
charge, (3) an act of leasing, (4) an act of importing, (5) 
an act of providing to the public via a bi-directional 
electronic communications network , and ( 6 ) an act of offering 

25 the public for transfer or lease using storefront displays, 
catalogs, or brochures. 

(E) When recording an AV Clip on the BD-ROM, an extension 
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header may be added to each TS packet in the AV Clip. The 
extension header is called a TP_extra_header, includes an 
a r r i va l_t ime_s tamp and a copy__permission_indicator , and has 
a data length of 4 bytes . TS packets with TP_extra_headers 
(hereafter n EX TS packets" ) are grouped in units of 32 packets , 
and each set is written to three sectors . One set made up 
of 32 EX TS packets has 6,144 bytes (=32 x 192), which is 
equivalent to a size of three sectors that is 6,144 bytes 
(=2,048 x 3). The 32 EX TS packets contained in the three 
sectors are called an Aligned Unit. 

In a home network connected with an IEEE 1394 connector, 
the reproduction apparatus 200 transmits an Aligned Unit in 
the following manner. The reproduction apparatus removes 
a TP_extra_header from each of the 32 EX TS packets in the 
Aligned Unit, encrypts the body of each TS packet according 
to the DTCP Specification, and outputs the encrypted TS 
packets. When outputting the TS packets, the reproduction 
apparatus inserts an isochronous packet between adjacent TS 
packets . A point where the isochronous packet is inserted 
is determined based on a time shown by an arrival_time_stamp 
of the TP_extra_header . The reproduction apparatus 200 
outputs a DTCP_descriptor , as well as the TS packets. The 
DTCP_descriptor corresponds to a copy_permission_indicator 
in the TP_extra_header . With the provision of the 
DTCP_descriptor indicating xv copy prohibited " , it is possible 
to prevent, when using the TS packets in the home network 
connected with the IEEE 1394 connector, the TS packets from 
being recorded to other devices . 



(F) The above embodiments describe the cases where an AV 
Clip of the BD-ROM Format is used as a digital stream, but 
the present invention can also be realized with a VOB (Video 

5 Object) of the DVD-Video Format or the DVD-Video Recording 
Format . The VOB is a program stream that complies with the 
ISO/IEC 13818-1 Standard and is obtained by multiplexing a 
video stream and an audio stream. Also, the video stream 
in the AV Clip may be an MPEG4 video stream or a WMV video 
10 stream. Further, the audio stream in the AV Clip may be a 
Linear PCM audio stream, a Dolby AC- 3 audio stream, an MP 3 
audio stream, or an MPEG- AAC audio stream. 

(G) The video editing described in the above embodiments 
may be obtained by encoding an analog image signal broadcast 
by analog broadcasting. 

Alternatively, analog/digital image signals recorded 
on a videotape may be encoded to obtain contents. Also, 
analog/digital image signals directly captured by a video 
camera may be encoded to obtain contents . A digital work 
distributed by a distribution server is applicable too. 

(H) Graphics objects described in the above embodiments 
is run-length encoded raster data. Run-length encoding is 

25 used for compression/encoding of graphics objects, because 
the run-length encoding is suitable for compression and 
decompression of subtitles. Subtitles have a property in 
that a continuous length of the same pixel value in a horizontal 
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direction is relatively long. Therefore, by performing 
compression using run- length encoding, a high compression 
rate can be attained. In addition, run-length encoding 
reduces a load for decompression, and is therefore suitable 
5 for realizing decoding by software. Nevertheless, the use 
of run-length encoding for graphics objects is not essential 
to the present invention. For example, graphics objects may 
be PNG data . Also, graphics objects may be vector data instead 
of raster data . Further , graphics ob j ects may be transparent 
10 patterns. 

(I) In a case where plural reproduction paths joint to one 
another, and that the default selected button changes 
depending on which reproduction path is to be taken, the 

15 following arrangement is preferable. That is, reproduction 
control in the dynamic scenario is described so that at the 
time when each reproduction path is passed, the eigenvalue 
for the reproduction path is set at the register of the 
reproduction apparatus, and that the reproduction processes 

20 are described so that buttons will be set in a selected state 
according to the values set in the register. By this 
arrangement , the button to be in a selected state can be changed 
according to which reproduction path is to be passed. 

25 (J) When the BD-ROM or the HD has a plurality of interactive 
graphics streams, which are each sub Clips, it is possible 
to provide STN_Table within the Playltem information of the 
playlist information, the STN_Table showing which of the 
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interactive graphics streams should be selected. Moreover, 
it is possible to use entries in the STN__table within the 
Playltem information, for the purpose of prioritizing among 
the interactive graphics streams. 

5 

Industrial Applicability 

A recording medium and a reproduction apparatus 
according to the present invention realize interactive 
control on movie works, - and so help provide the market with 
10 movie works of high added values, which helps invigorate the 
movie market and the consumer goods market. Accordingly, 
the recording medium and the reproduction apparatus according 
to the present invention are highly applicable in the movie 
industry and the consumer goods industry. 
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